What else should I expect from you, wise man, than pointing out my ignorance.
Racism starts when you feel the need to segregate people by the color of their skin, even by describing them as of different color, when this fact is absolutely irrelevant.
How you can see that term "colored" isn't derogatory is beyond me. Colored means that it's like that compared to white. It is racist. The fact that many people use it "in a good way" doesn't change anything. It only means they don't know what they say. Just like those who listen to them and think it's allright.
But , here I'm trying to talk some sense into you again, even if I know that this is pointless. How little I understand.