Insert > Page Numbers > Remove Page Numbers

You'll have to add the ones at the top right again (Insert > Page Number > Top of Page), but I don't know of any other way to do it