Conditional formatting on non-empty cells - VBA

I have two correlation matrices:

Input Correlation:

                Acc & Health	  AE	 Avemco Aviation	  Bail
Acc & Health	  1	         0.15	        0.15	         0.15
AE	        0.15	          1	        0.15	         0.25
Avemco Aviation	0.15	         0.15	          1	         0.15
Bail	        0.15	         0.25         	0.15	           1

Output Correlation:

	       Acc & Health	  AE	 Avemco Aviation   Bail
Acc & Health	  1			
AE	        0.158        	   1		
Avemco Aviation	0.139  	        0.158 	         1	
Bail	        0.177 	        0.258 	       0.130  	    1

Comparison Correlation (absolute value of Input - Output Correlation tables):

	      Acc & Health	  AE	 Avemco Aviation   Bail
Acc & Health	0.000			 
AE	        0.008	         0.000		
Avemco Aviation	0.011	         0.008	     0.000	
Bail	        0.027	         0.008	     0.020	   0.000

I'm applying conditional formatting to the Comparison Correlation table if the Input Correlation table values are greater than 0.2 AND if the cells in the Comparison Correlation table are NOT blank:

=and(InputB2:E5>=0.2,ComparisonB2:B5<>" ")

HOWEVER, I'm still getting formatting in blank cells like E3 (AE and Bail) since the input value is greater than 0.2. How do I fix this so no formatting is done on blank cells??

Any help will be appreciated!