We should discard misleading labels, but as I explain in my article on racism, every single concept, generalization, or label is "unfair" or inadequate to the facts, for Humean reasons. In generalizing, we simplify as implicit pragmatists, because no one can keep track of all the empirical details. We focus on what interests us, making judgments about relevance, and our models include idealizations.
As I argue elsewhere, the progressive's or wokester's political correctness is an unsustainable sideshow in philosophical terms. The ambitions of the mob's cancel culture don't withstand much philosophical scrutiny, because the wokester's assumptions are self-refuting.