No way to "freeze" it. However, you can remove the box from the formatting toolbar.

To do that, right-click on the toolbar and pick "Customize" at the bottom of the list that will show up. Then drag the size box off your toolbar.

You can still change the size by picking Font under the Format menu.