Try this:
In Outlook, go to File > Options > Calendar > Calendar Options > Default reminders > Change the current value to 0 minutes in the dropdown menu > OK.
If the dropdown menu won’t let you select your new time, select existing, then manually type in ‘0 minutes’.