Select the menu Tools -> Options and click the tab Spelling and Grammar. Now click the button Custom Dictionaries. You will see a list of Custom Dictionaries (usually only one) with the one you're using selected. Now click Modify. A window opens with all the words in the dictionary, then you can add/edit/delete words in this window.

Note: The process is slightly different for different Word versions.