Never mind. I figured it out myself.

You gotta open up the spreadsheet first, before you open the Word document, instead of vice-versa. That way, all changes to the spreadsheet are instantly updated to the Word document. The other way around, you have to close the Word document and reopen it to have the changes updated.

Simple solution, I should have tried it first before posting here.