What you are talking about is not really a border but a vertical line of right parenthesesn in a caption. A caption should really be a borderless Table. You can have one narrow cell in the table that simply holds the parentheses.