Check your styles. In particular, check the style for the level that you are having this problem with. In the style definition, what is the setting for the style for the following paragraph?

In setting up your numbering, did you follow all of the steps set out here?

How to create numbered headings or outline numbering in Ribbon Versions of Word by Shauna Kelly