You can't delete it because the rectangle doesn't exist in your document.
The "rectangle" appears because "Show text boundaries" is turned on. If you don't want the text boundaries to show simply go to File | Options | Advanced | Show document content and turn it off
|