I'm sure we've all had this problem. You close a document that you've had opened. Then you try to either delete it or rename it but you are prevented with the warning "File in Use. The action can't be completed because the file is open in Word. Close the file and try again."

Short of restarting my entire PC, how do I solve this problem?