Format the cells as Number > Custom > mm-yy

or, to ensure it stays in your format, in another column enter formula =TEXT(A1,"mm-yy")

Then you can copy and paste special > Values over original and then delete formulas.