Hitting the Delete key just clears the contents, you have to right click and select delete rows.

Another way i like is to :
Select the Column
Hit F5
Select Special Cells
Select Blanks-OK
Right Click on a selected cell and select Delete
Select "Entire Row"
OK