You can test your hypothesis of the slowness being related to the other sheets in the workbook - just copy your spreadsheet to another work book. Save the new book as TEST or something else. Close both/all workbooks. Reopen just the TEST worksheet and see if you still have the issue.

There are other possibilities. What is the current SIZE of the workbook? (File - Properites - Size)