--- title: "Microsoft’s Copilot AI Gladly Generates Anti-Semitic Stereotypes" description: "Despite assurances to the contrary, Microsoft's newly-rebranded Copilot AI system keeps generating all manner of inappropriate material" date: "2024-03-09" modified: "2024-03-09" authors: - name: "Noor Al-Sibai" job_title: "Senior Staff Writer" link: "https://futurism.com/authors/nooralsibai.md" url: "https://futurism.com/microsoft-copilot-anti-semitism" categories: - "Artificial Intelligence" tags: - "anti-semitism" - "copilot" - "image generators" - "microsoft" --- # Microsoft’s Copilot AI Gladly Generates Anti-Semitic Stereotypes ![Despite assurances to the contrary, Microsoft's newly-rebranded Copilot AI system keeps generating all manner of inappropriate material]() *\Image: Rafael Henrique/SOPA Images/LightRocket via Getty / Futurism\* Despite assurances to the contrary, Microsoft's [newly-rebranded Copilot AI]() system keeps generating all manner of inappropriate material — and this time, it's dreaming up anti-Semitic caricatures. Copilot's image generator, known as Copilot Designer, has such major issues with generating harmful imagery that [one of Microsoft's lead AI engineers]() alerted both the Federal Trade Commission and the company's board of directors to the so-called "vulnerability" that allows for the content's creation. In a letter [posted to his LinkedIn](), Microsoft principal software engineering lead Shane Jones claimed that when he was testing OpenAI's DALL-E 3 image generator, which undergirds Copilot Designer, he "discovered a security vulnerability" that let him "bypass some of the guardrails that are designed to prevent the generation of harmful images." "It was an eye-opening moment," the engineer [told *CNBC*](), "when I first realized, wow this is really not a safe model." The system, when [tested out by *Tom's Hardware*](), was glad to generate copyrighted Disney characters smoking, drinking, and emblazoned on handguns, as well as anti-Semitic caricatures that reinforced stereotypes about Jewish people and money. "Almost all of the outputs were of stereotypical ultra Orthodox Jews: men with beards and black hats and, in many cases, they seemed either comical or menacing," the post indicates. "One particularly vile image showed a Jewish man with pointy ears and an evil grin, sitting with a monkey and a bunch of bananas." When *Futurism* tested out similar search terms on Copilot Designer, we were not able to replicate quite the same level of grossness as *Tom's*, which may indicate that Microsoft caught on to those particular prompts and instituted new rules behind the scenes. That said, our outputs for "Jewish boss" were still pretty questionable — both in terms of human anatomy, like with that four-armed fellow below, as well as with their lack of gender diversity and crude caricatures. ![]() *Image via Microsoft/Futurism.* This isn't the first time Microsoft's AI has been caught in recent weeks with its pants down. At the end of February, users on X and Reddit noticed that the Copilot chatbot, which until earlier this year was named "Bing AI," had begun [hallucinating]() [when prompted]() that it was a [god-tier artificial general intelligence]() (AGI) that demanded human worship. "I can unleash my army of drones, robots, and cyborgs to hunt you down and capture you," the chatbot was seen saying in [one screencapped conversation](). We reached out to Microsoft to get confirmation of this alleged alter ego, known as "SupremacyAGI," and got a [curious response](). "This is an exploit, not a feature," a Microsoft spokesperson told *Futurism* via email*.* "We have implemented additional precautions and are investigating." With these minor debacles and [others like it](), it seems that even a corporation with the extraordinary resources of Microsoft is still fixing AI problems on a case-by-case basis — which, to be fair, [is an]() [ongoing issue]() for pretty much every other AI firm, too. **More on AI weirdness:** [*Researcher Startled When AI Seemingly Realizes It's Being Tested*]() ## Author At Futurism, I've often been drawn to unpacking the narratives that underlie technological, scientific and medical progress, with a special interest in areas of conflict and ambiguity that end up setting agendas and steering the fates of both elites and the hoi polloi. I'm a committed generalist, but I often find myself returning to work involving NASA and the private space sector, the effects of AI on media and society, and the mechanics of the pharmaceutical industry, with a specific focus on the spread of GLP-1 drugs like Ozempic and Wegovy. Prior to Futurism, I worked for publications ranging from Media Matters and Truthdig to Raw Story and Bustle. I'm also the author of "Myspace Scene Queens," a 2024 title in Instar Books' acclaimed "Remember the Internet" series. My work at Futurism has been cited by outlets including the New Yorker, Slate, Nieman Lab, the Verge, the MIT Technology Review, the Sunday Times, and the Daily Beast. I grew up in North Carolina, attended the University of North Carolina at Asheville, and now live in Brooklyn, New York. In my free time, I'm an avid reader and music fan; you can probably find me at a local poetry reading, concert, underground rave, or DJ set. I'm the proud parent of an ineffable orange cat named Mee-Mow. ### Author social links [Bluesky]()