Baw you seem to be reaching for a gotcha on the word "all" which is a shallow arguement. If you think there aren’t people very liberally using the term "Nazi" you’re lying to yourself or have your eyes closed. When the protesters were out defending statues there were a group of neo Nazis that participated in (one that I know of) a protest and the more left leaning posters grabbed it and assigned to anyone who protested the statues. It became an out, an easy way to jump into an arguement without anything to say. Much the same as a right wing poster might drop the Antifa name into a conversation as a way to paint the left in a negative light even if they have nothing at all to do with Antifa. You’re gotcha is empty, don't be that guy.
People defending monuments to people who fought for white supremacy and race based mass enslavement have a good bit more in common with Nazis than the average leftist does with antifa.
It appears that white southerners still haven’t fully come to grips with the moral horror the confederacy represented.