It sounds like a great idea and I would support it. However I would point out the following. At some point any negative associated with the reputation should be forgiven. Sometimes it is not the fault of the person.

Example. I was scammed by good-kama and gtg.witnesses as were others. I lost 663.843 in steem dollars and my reputation suffered as they spammed comments in my name. I have since recovered my reputation but in the system you are proposing I would forever have a tarnished reputation for being flagged for comments I did not make.

Forgiveness should be made and the slate clean in certain instances. God does that for us and we should do that for others. A color coded system is good if one can find eventual recovery of the reputation. Thanks @voronoi