Edit your Footer (Insert Tab > Footer). Place your insertion point/cursor just before your page number. Press the Enter key. This may result in repagination of your text.
Page Numbers in Word 2007-2016
You could also change the Space-Before paragraph formatting of the Footer paragraph Style. That is a more elegant solution.