"Statistics" is a very broad term for a wide range of data analyses.

Excel has several statistical functions. First you need to determine what type of statistics you want to derive from the data.

Here are a few "descriptive" statistics functions:

Mean (average)
Median
Mode
Min
Max
Standard Deviation
Percentile
Var (variance)

To see the full range of statistical functions press the Shift + F3 keys to activate the Insert Function dialog, then choose Statistical under the Category drop down.

SPSS is fairly costly, but for a decent SPC package at low cost and which proved pretty good range of additional analysis tools, see: QI Macros for Excel