Index Match using two criteria to return on of criteria values

Hello,
I have a data set with the following format:example.jpg


I have multiple rows sharing a number and containing a Boolean Y/N cell. I want to be able to look up the number, and if any of the rows containing that number contains Y, I want the result to be Y. If and only if all of the rows for a given number have N, the returned result would be N. I've seen ways to search for two criteria and return a third value from the row which matches both of those variables, but I have been having trouble with this particular set. Any help would be appreciated