Apparently you need to display the button in normal size to hide the label.
<gallery idMso="PropertyInsert" size="normal" showLabel="false"/>

The book that Charles pointed you at discusses this particular idiosyncrasy and suggests the very same workaround that you arrived at anyway.