^p is a paragraph mark - the end of a paragraph. ^l is a manual line break, ^t is a character inserted by the tab key.

You should not have to add anything. The replace that Paul gave you will not replace in headers or footers.

As for excluding headings, titles, subtitles... You didn't ask to do that originally.

I assume (hope) that your body text is all in one style and your headings, titles, subtitles are formatted using different (preferably heading) styles.

When you do the replace, make sure that the formatting for the find text is specified to be in the style used for your body text. You will find the Formatting choices by clicking on the More button in the Replace dialog.

If you didn't use Styles for your formatting, now might be a good time to learn to use them. You can also specify direct formatting but that is a lot more work!