HP did fight fascist wizards, though he still just wanted to restore the old order (which is was pretty fucked up) and then became a wizard cop (specifically wizard interpol IIRC) as an adult.

Certain kinds of fascists love imagining themselves as fighting the “real” fascists.