I don't see why you're using INDIRECT.

In your screencap those cells just contain numbers which I assume are supposed to be the column_index_num's.

See if this does what you want:

=N$4*VLOOKUP($B5,'BOM MATRIX'!$A$2:$AJ$500,N3,0)