How to make conditional formatting permanent

Hello, so in this example I need...
0/blank to show a red "X"
1 to show a yellow "!"
2 or more to show a green "check mark"
And all that next to the names, not in the duration row or the sub rows under the names.

Attached I included a mock table with the expectations. I attempted to highlight the irrelevant rows and clear the conditional formatting, but it didn't stick.

When I tried to do it I ran into the following issues
1. It was labor intensive and I was hoping there is an easier way.
2. Whenever I collapsed or expanded the list the conditional formatting went away for good.
3. I couldn't get the red "X" to show for the 0/Blank values.