I figured it out! Well at least I figured out a way to fix it. I used the power query tool and changed all the columns to duration and let it generate a table for me and then I used *that* data to make my pivot table and it works.