Though its convenience definitely helps make life easier, it's possible that your Amazon Echo never stops listening, even when you haven't activated it.
In the Alexa app, visit the hamburger-line More/Menu icon at the bottom to open the larger menu. The head to Settings > Hunches > the Hunches Settings gear icon in the upper right > Notifications.
12+ powerful Alexa commands you should start using at home (no subscriptions required) ...