I am pretty sure that the Outlook address book only displays contact records that have an e-mail address and/or a fax number entered.
You may find
Envelope or label add-in for Word useful, which has the ability to show all the records from Outlook contacts whether or not they have an e-mail or fax number recorded, in order to use the postal address associated with the record.