Alternating even and odd headers are two different headers. Their only connection is that they are in the same document.

If you want the line in both, you have to copy it from one where you have it to the one where it is not. Lines are commonly paragraph borders but can be graphic elements.

Header/Footer Settings Recap