You might come across some emails in Outlook that are being tracked, but you never tracked them going out, and they don’t have a tracking token (if your CRM instance is set up to use a tracking token).
Is CRM randomly tracking emails it thinks are important? Of course not, CRM is actually behaving, as you, or someone else, has told it to behave.
I emphasize “someone else”, as most likely you copied your outbound email to another CRM user in your company that has their Email settings set to Track “Email messages from Leads, Contacts and Accounts”. When you receive a response from your email, it will be tracked because the other CRM user has told CRM to track all emails from CRM contacts, etc.
Mystery solved…