As of 24 June 2023, the "Notifications" Pane no longer swings open to the left when starting up MS Outlook 2021.

Microsoft must have fixed this glitch in a recent update. Maybe they are actually reading our comments on this forum