When trying to uninstall office 365 Dynamics 365 Outlook Plugin, it attempts to uninstall, then loops back to trying to install. It never uninstalls.
Deleting all registry entries fixed the root problem. Look for all entries under:
Program Files (x86)\Microsoft Dynamics CR
Program Files\Microsoft Dynamics CRM