conditional average of 2 data columns

I am trying to get the conditional average of 2 data columns.

data_1 category data_2 category
2.5 Yes 1.2 No
4.2 No 2.6 No
3.5 Yes 3.9 Yes
4.1 No 2.5 Yes

What I need is the average across the 2 data columns (data_1 and data_2) for category Yes and category No. I know I can use averageif to get the conditional average of 1 column, but that doesn't work with 2.
Any suggestions will be greatly appreciated.
Thanks!

Hey Tony,
Thanks for the tip. That worked. How would that generalize if my 2 data groups are on 2 different worksheets? for instance, if I have data_1 and category on Sheet1 and then data_2 and category on Sheet2?

in most of the cases the data is in the same location on both sheets. There are about 15 data columns on each sheet and 3 categorization columns (data1 data2 ..... data15 category1 category2 category3). names of the sheets are survey1 and survey2 . there are multiple sheets in the workbook but only 2 data worksheets