I think Andrew has covered much of it.

• [Quick] Style Sets deal only with styles in the Quick Styles Gallery.
• If the styles are not used in a recipient document you will see no differences.
• Different Themes will change how many styles look.
• Any direct formatting is not likely to be changed by applying a Style Set.