The amygdala is indeed crucial for monitoring our environment and deciding what's worth getting worked up over. Once the amygdala determines this, however, it merely trips another circuit to actually produce the panic.
amygdala circuit crucial
These are some quotes by American author Sam Kean Writer.