The 'Vary colors by point' is not available via the UI on pivot charts.

Whilst you could set it in code it will cause each category item to appear in the legend and you will still need to manually change each colour.
activechart.chartgroups(1).VaryByCategories=true
To do it vary point color manually simple select the series, then select individual bar and format.