Those markers are paragraph markers. They mark the end of every paragraph. Be sure to turn on Show/Hide frequently, otherwise you'll be flying blind.

I'm thinking now that you want an inserted row to replace the existing row. If that is what your'e after, then no; you will have to delete the old row.