My friend, you are stating nothing short of the fact, color blindness is often time genetic but also can be caused by diseases while the person grows up but even with this, you still went ahead to state that it can not in a anyways cause any physical damage to the eye.

Best of luck my friend.