I have the exact same problem, and all of my reminders are automatically dismissed after they are presented one time. I also don't have an option in File > Options > Advanced > Reminders section to automatically dismiss reminders for past calendar events.