At first I started a new section for each chapter and quoted the section number as the chapter number in the header. That worked fine... But then I introduced footnotes and Word started insisting on starting a new page for each section...
A solution to that problem would also give me a fix for my problem!