It could be the numbers are being recognized as text. Try multiplying the Vlookup formula's by one. Example:
=VLOOKUP(Sheet2!$A1,Sheet1!$A:$D,2,FALSE)*1