Entering calendar notes that invitees can't see

[rmillertaflaw]

We use the notes field to document info about the client we will be meeting with, driving notes, confirmation notes, etc. We don't want the client and their advisor (invitees on the appointment) to be able to see these notes. If we create a custom page to add the notes, is there a way to hide that page from invitees so only the appointment originator can the info?