As Excel needs to upload / build everything to memory so the more items, the slower …

Save the workbook as a new .xlsx workbook so all VBA codes will automaticly be removed,
close this new workbook and see if it's still the same when you open it.