Oops, I used the Greater than sign. Assumptions, your range that you are conditionally formatting starts at A1 (change A1 to the first cell in your range otherwise).
your value (e.g. 40) is in C1 (change $C$1 to appropriate cell)
=OR(ISTEXT(A1),A1<$C$1)
Is that better?