Conditional formatting chart data labels?

My data layout is:

   A      B        C        D          E
Label | value 1 | value 2 | value 3 | Boolean
  X   |    1    |     2   |    3    |  =IF($D2=0,1,0)

I have a stacked column chart based on data A:D

Is it possible to format the data label text RED where the value in E = 1?

Non VBA solution preferred if possible but will accept VBA if necessary.