This will happen mainly for two reason. Your anti-virus is scaning your e-mails to long or you have a e-mail on your server that is making this happen. It's usely cause of a e-mail that is on your server that is doing this, in that case you would just delete the mail of the server.
Or your outlook profile is not working right. Creating a new profile and importing you pst will fix it.