Click the menu "Start -> Programs -> Microsoft Office Tools -> Microsoft Office 2003 Language Settings", then you can change the default language in the dialog.

I think it's a good idea to learn a foreign language by installing Windows or software in its version.