I just realized that I over-complicated the formula

=SUMPRODUCT(($A$2:$A$20000=A2)*($B$2:$B$20000<B2))+1
to rank lower values as lower rank number
or
=SUMPRODUCT(($A$2:$A$20000=A2)*($B$2:$B$20000>B2))+1
to rank higher values as lower rank number