Don't delete the photo. Instead, select the photo and go to the Format tab on the Ribbon and click Change Picture. You'll be able to swap the photo without disrupting the animations.