When said 'fans' are harmful it really does.
Here's a counterexample to your hypothesis. Fans of Nazis require denouncement at every turn.
I'd rather dissent so others know dissent is a rational response.