I mean, when people deliberately try and teach it racist/Offencive stuff then yeah. And it says alot about the Natuer vs Nurture debate. Since Self learning AI that isnt taught wrong shit have been more or less stable.

Actually this kinda scenario could help in the understanding of Radicalization and indoctrination.

I know various goverments and bored dudes must have made self learning AI's. I am curious to see if any of them are willing to try this type of experiment.