Statistics in Excel HELP!

Hi everyone, first thanks for the help.

I am trying to create a histogram and let me explain some of the data.

I have a list of data separated like so:
3.5
3.6
3.8
3.8
3.9
3.9
etc...

Now I need to calculate the frequencies of these like so:
3.5 (up to but not including) 4.0
4.0 (up to but not including) 4.5

I can count out the frequencies myself but i need to create a histogram (bar graph) with the y axis as the frequency and the x axis as the IMR(infant mortality rate: ie the 3.5 (up to but not including) 4.0).

I am having problems with calculating the frequencies because when setting the bin values because they include 4.0.

If this is confusing I can provide some more information, but cannot find a good tutorial that would create a histogram anywhere remotely close to the histogram i drew by hand.