Try going into Page Layout > Columns > More Columns > Spacing > Reduce in size > OK
This closes the gap, but equalizes the column widths. You may not want that to happen.
If you un-check Equal column width, you can change the column widths and as before, change the Spacing to suit your needs.
As suggested above by gmayor, the table option may be more suitable/manageable.