People are afraid of “looking racist” and/or being called out on their racist behavior.
I am logical and direct, not rude or mean. So you are not going to be able to make me feel bad about my actions. And even if I were rude and mean I would have every right to be towards someone promoting racism against my race.