Yes, it would speed up scrolling through the document. You may want to save a copy (with all the changes still marked) first.

Using styles for all or at least most of your formatting will speed things up as well. Understanding Styles in Microsoft Word