Do you have a combination of "keep with next" and "keep lines together" paragraph formatting in the paragraph that starts the second column?

For a quick answer, see Word's Reveal Formatting Codes.