To have page numbering restart in each section, use the format page numbers dialog in each section to begin numbering at 0.

• This assumes that you want to have the first page after the cover page be numbered 1.
• This assumes that the first cover page was not generated by Word's Insert Cover Page function. (If it was, the Cover page is already set as 0 for the first section.)

Resource: Cover Page Anomalies