I suppose using Ctrl-Z to straighten the wrongly-angled quote mark could be a solution but one, it also wastes typing time and two, the angled mark looks much better on the page (rather than the straight one you get).

There must be a way to get it without jumping through backspace/delete/copy/paste hoops.