It seems to be permanent within a document. Also, the lines don't disappear entirely; they're present here and there, but don't accurately reflect the amount of changes present.