You may Shift+Click the X to close the application or you may also add the Exit button to the Quick Access Toolbar.