An other of doing this would be to use the AVERAGEIF or AVERAGEIFS functions. See Excel help for details.

Sounds like you need an additional criteria table as the criteria will be different.