Solved. You can either go to Table Tools, Layout, Delete and having highlighted the unwanted cells, choose the option that says Delete Entire Row.

The other way is to highlight the empty cells and just hit Delete. That works.