When you are editing a footer you can press Alt-Shift-P and it will enter a PAGE field for you that will change with the page number.

You can also use the Insert Page Number command. It is under the Insert tab. Note, though, except for the command to insert the page number at the current location, these will overwrite your header or footer.

See Sections / Headers and Footers for more information.