Nope? It hasn't been there before. This ain't the border of the whole application, but it seems to belong to the inner window of the worksheet. And it should disappear when maximized.

Compare, there's no such thing in word, the scrollbar is the last thing to the right of the screen: