In Format > Bar Styles you can add text to the left of the summary task bars.

You may also want to look into creating some task bar styles (using Flag fields) to create the different color roll up bars. It is more efficient than individual formatting.