You are defending a racist instead of the people of color that he is trying to hurt.
What he said wasn’t merely “ignorant”; it was dehumanizing, harmful, promoting violence and racism.
People calling his house to tell him what he did was wrong is not harassment; it’s education.