You are right that you can't do any editing from within the Caption dialog box. You will have to do it directly in the document. For example, if you want to delete the third table caption, select it (in the body of the document) and press Delete. If the caption is inside a text box, select the whole text box and delete it.

__________________
Stefan Blom
Microsoft Word MVP

Microsoft 365 apps for business
Windows 11 Professional