When you move a shape with a connector attached, the connector will move and the slope will change...it is supposed to. You could disconnect the connector prior to moving the shape to eliminate any potential rotation of the shape. However, I do not understand how the label/shapes orientation is rotating.

Can you attach a representative file where the problem exist? I wouldn't mind checking that out.