It's possible that Outlook Express didn't finish downloading all emails due to interrupted Internet connection, huge email attachments, etc, the next time you open it, it tried to start over. If your email account has a web version, logged on to it and delete the emails on the server directly.
BTW, MS has stopped the development of Outlook Express, you may want to check out
Windows Live Mail.