If you have delegated mailboxes which are either not removing or a syncing the below KB's will help.

Disable Outlook Auto-Mapping with Full Access Mailboxes: Exchange 2010 Help | Microsoft Learn