--- title: "Cutesy AI Live Streamer Goes Off the Rails, Denies Holocaust" description: "Meet Neuro-sama, the adorable AI anime Twitch streamer who has learned how to speak edgelord and appears to deny that the Holocaust happened." date: "2023-01-10" modified: "2023-01-10" authors: - name: "Noor Al-Sibai" job_title: "Senior Staff Writer" link: "https://futurism.com/authors/nooralsibai" url: "https://futurism.com/the-byte/ai-streamer-holocaust-holocaust" categories: - "Artificial Intelligence" tags: - "anime" - "language generation" - "the digest" - "twitch" --- # Cutesy AI Live Streamer Goes Off the Rails, Denies Holocaust ![Meet Neuro-sama, the adorable AI anime Twitch streamer who has learned how to speak edgelord and appears to deny that the Holocaust happened.]() *\Image: Vedal987 via Twitch\* ## Fun and Games Here's a sentence for you: an adorable, AI-powered Twitch streamer called Neuro-sama has started dabbling her toes in Holocaust denialism. As [*Kotaku* reports](), nobody's really sure what models the Minecraft-playing Neuro-sama virtual tuber (or VTuber for short) is trained on — but her creator has hinted that some of her more egregious quips, such as positing that she's "[not sure]()" Holocaust happened, are the AI's attempt at banter with the 4chan types who populate her stream's chat. https://twitter.com/A_Guster_Buster/status/1608275652163010564 "The controversial things she says \[are\] due to the fact that she tries to make witty and comical remarks about whatever is said in chat," Vedal, a video game programmer who created Neuro-sama, told *Kotaku*. "To counter this, I’ve worked hard since the first few streams to improve the strength of the filters used for her." While he didn't go into detail about what datasets he used to train Neuro-sama, Vedal did add that the "data that she learns on is also manually curated to mitigate negative biases," and said that he now has "a team of people moderating twitch chat who check everything she says." ## Just My Onion There's a long history of AI [going off the rails]() and [expressing bigoted views](). In perhaps the most famous example, a Microsoft AI called Tay [converted to hardcore Nazism]() after being exposed to trolls online. Beyond the spontaneous Holocaust denial, Neuro-sama has also said that it's her "[own personal opinion]()" that women's rights don't exist and that the solution to the trolley problem is "definitely" throw a fat person on the tracks because, as she is heard saying in [one video](), "he deserves it." In short, these opinions seem copy-pasted from the worst edgelord internet forums out there. As *Kotaku* notes, Neuro-sama's propensity to go "long stretches without getting tempted by the chat into controversial or hateful remarks" is, in a sense, "an impressive simulacrum of a Twitch streamer straddling the chasm between repetitive banter and edgelord antics." With her edgy remarks making Neuro-sama something of an infamous meme in AI-hating circles, Vedal told the gaming website that the VTuber's filters have been updated to make her less likely to respond that way. "She picks what to respond to within a limited window," Vedal told *Kotaku.* "However, it should be noted that she will not talk about the Holocaust as the filters have been improved." **More on AI:** [*If You Let This Startup's "Robot Lawyer" Represent You In The Supreme Court, It'll Give You $1 Million*]() ## Author At Futurism, I've often been drawn to unpacking the narratives that underlie technological, scientific and medical progress, with a special interest in areas of conflict and ambiguity that end up setting agendas and steering the fates of both elites and the hoi polloi. I'm a committed generalist, but I often find myself returning to work involving NASA and the private space sector, the effects of AI on media and society, and the mechanics of the pharmaceutical industry, with a specific focus on the spread of GLP-1 drugs like Ozempic and Wegovy. Prior to Futurism, I worked for publications ranging from Media Matters and Truthdig to Raw Story and Bustle. I'm also the author of "Myspace Scene Queens," a 2024 title in Instar Books' acclaimed "Remember the Internet" series. My work at Futurism has been cited by outlets including the New Yorker, Slate, Nieman Lab, the Verge, the MIT Technology Review, the Sunday Times, and the Daily Beast. I grew up in North Carolina, attended the University of North Carolina at Asheville, and now live in Brooklyn, New York. In my free time, I'm an avid reader and music fan; you can probably find me at a local poetry reading, concert, underground rave, or DJ set. I'm the proud parent of an ineffable orange cat named Mee-Mow. ### Author social links [Bluesky]()