--- title: "The AI Industry Has a Huge Problem: the Smarter Its AI Gets, the More It’s Hallucinating" description: "Artificial intelligence models have long struggled with hallucinations. The problem is getting worse as they become bigger and smarter." date: "2025-05-05" modified: "2025-05-05" authors: - name: "Victor Tangermann" job_title: "Senior Editor" link: "https://futurism.com/authors/victor" url: "https://futurism.com/ai-industry-problem-smarter-hallucinating" categories: - "Artificial Intelligence" tags: - "ai chatbots" - "ai hallucinations" - "chatgpt" - "OpenAI" --- # The AI Industry Has a Huge Problem: the Smarter Its AI Gets, the More It’s Hallucinating ![Artificial intelligence models have long struggled with hallucinations. The problem is getting worse as they become bigger and smarter.]() *\Image: Getty / Futurism\* Artificial intelligence models have long struggled with hallucinations, a conveniently elegant term the industry uses to denote fabrications that large language models often serve up as fact. And judging by the trajectory of the latest "reasoning" models, which the likes of Google and AI have designed to "think" through a problem before answering, the problem is getting worse — not better. As the [*New York Times* reports](), as AI models become more powerful, they're also becoming *more* prone to hallucinating, not less. It's an inconvenient truth as users continue to flock to AI chatbots like OpenAI's ChatGPT, using it for a growing array of tasks. By having chatbots spew out dubious claims, all those people risk embarrassing themselves or worse. Worst of all, AI companies are struggling to nail down why exactly chatbots are generating more errors than before — a struggle that highlights the head-scratching fact that [even AI's creators don't quite understand]() how the tech actually works. The troubling trend challenges the industry's broad assumption that AI models will become more powerful and reliable as they scale up. And the stakes couldn't be higher, as companies [continue to pour tens of billions of dollars]() into building out AI infrastructure for larger and more powerful "reasoning" models. To some experts, hallucinations may be inherent to the tech itself, making the problem practically impossible to overcome. "Despite our best efforts, they will always hallucinate," AI startup Vectara CEO Amr Awadallah told the *NYT*. "That will never go away." It's such a widespread issue, there are entire companies dedicated to helping businesses overcome hallucinations. "Not dealing with these errors properly basically eliminates the value of AI systems," Pratik Verma, cofounder of Okahu, a consulting firm that helps businesses better make use of AI, told the *NYT*. The news comes after OpenAI's latest AI reasoning models, o3 and o4-mini, which were launched late last month, were [found to hallucinate more than earlier versions](). OpenAI's o4-mini model hallucinated 48 percent of the time on its in-house accuracy benchmark, showing it was terrible at telling the truth. Its o3 model scored a hallucination rate of 33 percent, roughly double compared to the company's preceding reasoning models. Meanwhile, as the *NYT* points out, Google and DeepSeek's competing AI models are suffering from a similar fate as OpenAI's latest offerings, indicating it's an industry-wide problem. Experts [have warned]() that as AI models become bigger, the advantages each new model has over its predecessor could greatly diminish. With firms quickly [running out of training data](), they're turning to synthetic — or AI-generated — data instead to train models, which [could have disastrous consequences](). In short, despite their best efforts, hallucinations have never been more widespread — and at the moment, the tech isn't even heading in the right direction. **More on AI hallucinations:** *["You Can’t Lick a Badger Twice": Google's AI Is Making Up Explanations for Nonexistent Folksy Sayings]()* ## Author I've been at Futurism since 2017, where my role has evolved to encompass design, writing, and increasingly editing. I've always been fascinated by space exploration and advanced transportation, which I've leaned into by interviewing luminaries in those fields while closely following the dimensions of policy and regulation that allow next-generation projects to succeed -- or, sometimes, to fail. I'm also keenly interested in the effects of generative AI on society, policies, and democratic institutions, as well as clean energy, physics and biology, and the vagaries of tech leadership. My work for Futurism has been cited by publications including Ars Technica, Gizmodo, PC Magazine, Jalopnik, Fox News, and the New York Post. I spent my childhood living in locations including Manila, the Philippines, and Geneva, Switzerland, attended McGill University, and now live in Toronto, Canada. Before Futurism I worked at AskMen and a small photography studio. In my free time, I'm an avid gardener, foodie, and craft beer lover, as well as a maker of artisanal hot pepper sauces. I have a magnificent dog named Freida. ### Author social links [Bluesky]()