You should open the normal template and set it to portrait orientation. This will deal with new documents. It will not change any documents that are saved in landscape orientation. For existing documents, you should be aware that each section will have its own orientation setting.

Normal Template in Microsoft Word - How to Find or Open the Normal Template
Sections / Headers and Footers in Microsoft Word 2007-2013