Showing paragraph marks is a key to figuring out what word is doing, no question.
However, with a multi-level list you really want to have your numbering attached to styles following ALL of the directions at
How to create numbered headings or outline numbering in Word 2007 and Word 2010. The buttons on the Ribbon will work, so long as you don't want to do editing or have multiple people using it.