If you want the template to show up in the New Files dialog, yes.
File New Variations in the Versions of Word

If the user is just double-clicking on the icon or a shortcut to the template, then it does not matter where it is stored. I prefer to store it in either the user templates folder or in the workgroup templates folder, so it can show up in the new file dialog.