What kind of windows are opening? Are they the regular Outlook Inbox window, a New Message window, or a specific email in a new window? Do they start opening as soon as you boot to Windows, or does email have to be manually opened first before it starts?

You can easily elect to not install Outlook with the rest of the Office suite. You just need to do a custom installation and unselect the Outlook products.

-SW