If I understand correctly, you are wanting symbols straight as they appear here (' and ") rather than curled as they appear in Word. If that is the case, one way to do that is via the INSERT Ribbon by selecting SYMBOL, setting the font to Times New Roman and selecting character codes 34 (for quotation) and 39 (for apostrophe). There must be another, shorter keystroke process to do that but, that is my immediate thought.

Others may offer a better solution...