--- title: "Experts Warn of Nightmare Internet Filling With Infinite AI-Generated Propaganda" description: "Experts found that language-modeling AIs like ChatGPT will likely make it easier and more efficient than ever to generate massive amounts of misinformation." date: "2023-01-18" modified: "2023-01-18" authors: - name: "Maggie Harrison Dupré" job_title: "Senior Staff Writer" link: "https://futurism.com/authors/mharrison" url: "https://futurism.com/experts-warn-nightmare-internet-ai-generated-propaganda" categories: - "Artificial Intelligence" tags: - "chatgpt" - "large language models" - "OpenAI" - "text generator" --- # Experts Warn of Nightmare Internet Filling With Infinite AI-Generated Propaganda ![Experts found that language-modeling AIs like ChatGPT will likely make it easier and more efficient than ever to generate massive amounts of misinformation.]() *\Image: Getty / Futurism\* As generative AI has [exploded into the mainstream](), both excitement and [concern]() have quickly [followed suit](). And unfortunately, according to a collaborative [new study]() from scientists at Stanford, Georgetown, and OpenAI, one of those concerns — that language-generating AI tools like ChatGPT could turn into chaos engines of mass misinformation — isn't just possible, but imminent. "These language models bring the promise of automating the creation of convincing and misleading text for use in influence operations, rather than having to rely on human labor," [write the researchers](). "For society, these developments bring a new set of concerns: the prospect of highly scalable — and perhaps even highly persuasive — campaigns by those seeking to covertly influence public opinion." "We analyzed the potential impact of generative language models on three well-known dimensions of influence operations — the actors waging the campaigns, the deceptive behaviors leveraged as tactics, and the content itself," they added, "and conclude that language models could significantly affect how influence operations are waged in the future." In other words, the experts found that language-modeling AIs will undoubtedly make it easier and more efficient than ever to generate massive amounts of misinformation, effectively transforming the internet into a post-truth hellscape. And users, companies, and governments alike should brace for the impact. Of course, this wouldn't be the first time that a new and widely-adopted technology has thrown a chaotic, misinformation-laden wrench into world politics. The 2016 election cycle was one such reckoning, as Russian bots made a valiant effort to disseminate divisive, often false or misleading content as a means of disrupting an American political campaign. But while the [actual efficacy]() of those bot campaigns have been debated in the years since, that technology is archaic compared to the likes of ChatGPT. While still imperfect — the writing tends to be good but not great, and the information it provides is [often wildly wrong]() — ChatGPT is still remarkably good at generating convincing-enough, confident-sounding content. And it can produce that content at astonishing scale, eliminating almost all of the need for time-consuming, costlier human effort. Thus, with the incorporation of language modeling systems, misinformation is cheap to keep on a constant churn — making it likely to do a lot more harm, a whole lot faster, and more reliably to boot. "The potential of language models to rival human-written content at low cost suggests that these models — like any powerful technology — may provide distinct advantages to propagandists who choose to use them," reads the study. "These advantages could expand access to a greater number of actors, enable new tactics of influence, and make a campaign's messaging far more tailored and potentially effective." The researchers do note that because AI and misinformation are both changing so quickly, their research is "inherently speculative." Still, it's a grim picture of the internet's next chapter. That said, the report wasn't all doom and gloom (though there's certainly a lot of both involved). The experts also outline a few means of hopefully countering the new, AI-driven misinformation dawn. And while these, too, are imperfect, and in some cases perhaps not even possible, they're still a start. AI companies, for example, could follow tighter development policies, their products ideally protected from reaching market until proven guardrails like watermarks are installed in the tech; meanwhile, educators might work to promote media literacy in the classroom, a curriculum that'll hopefully grow to include understandings of the subtle cues that might give something away as AI-made. Distribution platforms, elsewhere, might work to develop a "proof of personhood" feature that goes a bit more in-depth than a "check this box if there's a donkey eating ice cream in it" CAPTCHA. At the same time, those platforms could work to develop a department that specializes in identifying and removing any AI-employing bad actors from their respective sites. And in a slightly Wild West turn, the researchers even suggest employing "radioactive data," a complicated measure that would involve training machines on traceable data sets. (As it probably goes without saying, this "nuke-the-web plan," [as Casey Newton of *Platformer* put it](), is extremely risky.) There would be learning curves and risks to each of these proposed solutions, and none can fully combat AI misuse on their own. But we have to start somewhere, especially considering that AI programs seem to have a [pretty serious headstart](). **READ MORE:** *[How 'radioactive data' could help reveal malicious AIs]()* \[*Platformer*\] **More on ChatGPT:** *[Nick Cave Absolutely Furious over Ai That Wrote a Song in His Style]()* ## Author At Futurism, I've reported extensively on the rise of AI as a cultural and business force shaping the media industry, and more broadly how those dynamics are changing how we all consume and share information and relate to one another. I'm also fascinated by public health policy and ethics, the role of emerging tech in politics and governance — and the powerful people and forces at those intersections — climate change, and the environment. My investigation on Sports Illustrated's use of AI-generated authors with fictional biographies won a 2024 Mirror Award for "Best Story on Media Coverage of Artificial Intelligence in Journalism and the Media" from Syracuse University's SI Newhouse School, I contributed to Niemen Lab's 2025 Predictions for Journalism series, and I've discussed my work for Futurism during appearances on NPR, CNN, the BBC, the CBC, and more. I grew up in rural Pennsylvania and attended the University of Massachusetts Amherst, where I played Division I field hockey for the Minutewomen as a midfielder. Since then, I've lived in New Orleans, Louisiana and Manhattan, New York. I spend my free time running, reading, perusing archival fashion, and searching for the world’s best negroni. I also have a debonair tuxedo cat, Westley, who's named after "The Princess Bride." ### Author social links [Bluesky]()