Go to any page that starts over as page 2.
Under page numbers select format page numbers. Tell Word to continue the numbering from the previous section.


This happens because you (1) at some point told Word to restart numbering, and (2) added the Columns. When you change columns, it creates one or two section breaks. At each of these, the numbering then restarts (taking a cue from you previous restart).