For Excel 2007:

Office2007 button>Excel Options>Advanced> in Cut, copy, and paste section, uncheck "Show Insert Options button".