Defining chart colours by cell entries

I have some VBA code that I am using to change the background colour of cells in my column A using values in columns B,C,D to define the RGB components of the colour.
e.g. Red | 255 | 0 | 0 turns the first cell's background to red.

I've created a column chart using the column A values as x-values and some other data in column E as y-values. What I want is to make the fill colour of the columns in the chart the same as the background colour of the cells in the worksheet.

Please see attached file - thanks in advance for your help