I don't understand how hard it is get that berating someone for one of their faults will almost always make things worse. It takes more than yelling to make someone change.

I've been called a nazi for being more center than left. I didn't let that sway me to the radical right.
I've been called a commie for being more center than right. I didn't let that sway me to the radical left.
I know it is horrible to have stupid people screaming at you because you don't fit into their dichotomy, but if it gets to you, that's on you.

Saying that you started hanging out with Nazis/Communists because people in the streets or people closer to you kept calling it a Nazi/Communist. Is not okay, it is not acceptable. You allowed what the "enemy" said change your beliefs. It is how it normally is, yes. It is how most people work. It shouldn't be how it is.

Saying "I wasn't a nazi before. But then the antifa nation attacked" speaks badly of you and the people who kept spewing hatred at you. If you truly wanted to spite these people, you should have stood by your beliefs and proved them wrong by NOT hanging out with the people they accused you being part of.I have sympathy for you for having dealt with that hatred, but the fact that you gave into their insults limits how much of that sympathy remains.