Give this a try:
Open Excel.
With just the opening blank Work Book on show, click the Office Button > Excel Options > Advanced > Scroll down to Display.
Un-Check ‘Show all windows in the Taskbar’ > OK.



Close Excel > Restart Excel (blank Work Book showing), open a new Work Book(s) > Now close the new Work Book(s) or Excel for a comparison.