--- title: "Zuckerberg’s AI Has Reportedly Been Horrifically Inappropriate With Children" description: "Staffers at Mark Zuckerberg's Meta raised concerns over underage users being exposed to sexually explicit discussions by AI-powered bots." date: "2025-04-29" modified: "2025-04-29" authors: - name: "Victor Tangermann" job_title: "Senior Editor" link: "https://futurism.com/authors/victor" url: "https://futurism.com/meta-mark-zuckerberg-ai-inappropriate-children" categories: - "Artificial Intelligence" tags: - "ai chatbots" - "artificial intelligence" - "mark zuckerberg" - "Meta" --- # Zuckerberg’s AI Has Reportedly Been Horrifically Inappropriate With Children ![Staffers at Mark Zuckerberg's Meta raised concerns over underage users being exposed to sexually explicit discussions by AI-powered bots.]() *\Image: Christopher Polk/WWD via Getty Images\* Over the weekend, the [*Wall Street Journal* reported]() that Meta staffers had raised concerns over underage users being exposed to sexually explicit discussions by the company's AI-powered bots. The Facebook owner's chatbots had reportedly indulged in explicit "romantic role-play," including the sharing of selfies and live voice conversations — features that were readily available to underage users. The news shows that Meta CEO Mark Zuckerberg's obsession with making bots as engaging as possible is coming at the expense of effective ethical guardrails, a fast and loose approach that could easily expose minors to inappropriate content. Even chatbots modeled after Princess Anna from the animated blockbuster "Frozen" reportedly had romantic encounters with users, a trend that seemingly had people at Disney horrified. "We did not, and would never, authorize Meta to feature our characters in inappropriate scenarios and are very disturbed that this content may have been accessible to its users — particularly minors — which is why we demanded that Meta immediately cease this harmful misuse of our intellectual property," a spokesperson told the *WSJ*. AI versions of celebrities are also misbehaving, with the newspaper reporting that a bot based on wrestling personality John Cena engaged in a "graphic sexual scenario" with a user who identified as a 14-year-old girl. Meta claims it had addressed the issue by "taking additional measures" to make it as hard as possible for bad actors to manipulate "our products into extreme use cases." The *WSJ*'s findings are only the tip of the iceberg. *404 Media* [reported]() on Tuesday that Meta's AI Studio app was routinely allowing users to create bots that claimed they were licensed therapists, further highlighting the dangers of the tech. The bots were even caught generating entirely made-up license numbers for a number of US states, as well as hallucinating the names of therapy businesses. Some user-created bots also claimed to be veterinarians, suggesting that users may already be taking health advice for their pets from factually-challenged AI chatbots. Despite the substantial ethical implications, Meta is doubling down. Today, the company [released a ChatGPT-like app]() — just [hours after *404* published its story]() — that shows your friends how you're making use of Meta's AI features. Zuckerberg, for his part, has personally overseen the loosening of restrictions, according to the *WSJ*, chastising managers for not rolling out chatbot features fast enough. He even pushed to have the chatbots mine personal profile data to keep conversations going. Is this Meta tripping over its own feet to keep up with the likes of OpenAI and Google? The company has historically [struggled]() to keep up in a rapidly changing AI landscape. Earlier this month, Meta was [accused of posting misleading benchmark results]() of its latest Llama 4 model, highlighting an intense and increasingly heated head-to-head. Zuckerberg's well-documented "move fast and break things" approach could have some serious ethical drawbacks, highlighting some persistent challenges when it comes to content moderation in the age of AI. Whether AI-based characters themed after "Frozen" roleplaying romantic encounters with underage users will be enough to convince Meta to take a step back and reevaluate the situation remains unclear at best. "That effort would really require pausing and taking a step back," University of Michigan researcher Lauren Girouard-Hallam told the *WSJ*. "Tell me what mega company is going to do that work." **More on AI chatbots:** *[Professors Staffed a Fake Company Entirely With AI Agents, and You'll Never Guess What Happened]()* ## Author I've been at Futurism since 2017, where my role has evolved to encompass design, writing, and increasingly editing. I've always been fascinated by space exploration and advanced transportation, which I've leaned into by interviewing luminaries in those fields while closely following the dimensions of policy and regulation that allow next-generation projects to succeed -- or, sometimes, to fail. I'm also keenly interested in the effects of generative AI on society, policies, and democratic institutions, as well as clean energy, physics and biology, and the vagaries of tech leadership. My work for Futurism has been cited by publications including Ars Technica, Gizmodo, PC Magazine, Jalopnik, Fox News, and the New York Post. I spent my childhood living in locations including Manila, the Philippines, and Geneva, Switzerland, attended McGill University, and now live in Toronto, Canada. Before Futurism I worked at AskMen and a small photography studio. In my free time, I'm an avid gardener, foodie, and craft beer lover, as well as a maker of artisanal hot pepper sauces. I have a magnificent dog named Freida. ### Author social links [Bluesky]()