from what i understand, you are not looking to SUM any numbers, so you may just be able to use simple INDEX/MATCH like you conjectured...

in D4:

=INDEX($B$10:$M$12,MATCH($A4,$A$10:$A$12,0),MATCH(D$3,$B$9:$M$9,0))