There is a setting (at least in Excel 2010) in Excel Options, Advanced, Display, for cells with comments show:
- No Comments or Indicators
- Indicators only, and comments on hover
- Comments and Indicators