You can use Custom mm/yy to format a date as mm/yy but it still has to be inputted in a way that Excel recognizes it as a date.

You will have to type in a slash or a hyphen between the month number and the year.