--- title: "OpenAI Team Tasked With Stopping AI From Triggering Nuclear Armageddon" description: "OpenAI has created a new team whose whole job is heading off the \"catastrophic risks\" that could be brought on by artificial intelligence." date: "2023-10-27" modified: "2023-10-27" authors: - name: "Noor Al-Sibai" job_title: "Senior Staff Writer" link: "https://futurism.com/authors/nooralsibai" url: "https://futurism.com/the-byte/openai-preparedness-team-catastrophic-risks" categories: - "Artificial Intelligence" - "OpenAI" tags: - "agi" - "OpenAI" - "sam altman" - "the digest" --- # OpenAI Team Tasked With Stopping AI From Triggering Nuclear Armageddon ![OpenAI has created a new team whose whole job is heading off the "catastrophic risks" that could be brought on by artificial intelligence.]() *\Image: Getty / Futurism\* ## Nuclear Catastrophe OpenAI has created a new team whose whole job is heading off the "catastrophic risks" that could be brought on by artificial intelligence. Oh, the irony. In a [blog post](), OpenAI said its new preparedness team will "track, evaluate, forecast, and protect" against AI threats, up to and including those that are "chemical, biological, radiological, and nuclear" in nature. In other words, the company that's at the forefront of making AI a [household anxiety](), while also [profiting hugely off of the technology](). claims it's going to mitigate the worst things AI could do — without actually explaining *how* it plans to do that. ## Why So Serious Besides the aforementioned doomsday scenarios, the preparedness team will work on heading off "individual persuasion" by AI — which sounds a lot like tamping down the tech's [burgeoning propensity]() for [convincing people to do things]() they might not otherwise. Additionally, the team will also tackle cybersecurity concerns, though OpenAI didn't go into detail about what that — or anything else the announcement mentioned, for that matter — would entail. "We take seriously the full spectrum of safety risks related to AI," the announcement continues, "from the systems we have today to the furthest reaches of superintelligence." We might have different definitions of what taking things "seriously" means here, because from our vantage point, working to build smarter AIs doesn't seem like a great way to make sure AI doesn't end the world. But we digress. ## AI Anxiety In its very first line, the update said that OpenAI is taking it upon itself to mitigate major risks associated with AI "as part of our mission of building safe \[artificial general intelligence\]." Artificial general intelligence (AGI) is the industry term for AI that is of human- or, perhaps, superhuman intelligence — a point on which [OpenAI CEO Sam Altman]() can't seem to agree with himself. Altman's stance on both AGI and the potentially dangerous future of AI has been the subject of scrutiny. He's repeatedly made public comments about [how anxious it seems to make him](), a confounding reality, given his company's great successes and pivotal role in developing the tech. In May, the CEO was even candid in [testimony before Congress]() about his concerns over what could happen if AI goes off the rails. "I think if this technology goes wrong, it can go quite wrong," Altman said at the time. "And we want to be vocal about that. We want to work with the government to prevent that from happening." This preparedness team is likely an outcropping of the OpenAI CEO's otherwise open-ended agitating about the dangers AI could pose. At the same time, it seems awfully strange that a firm whose explicit goal is building an AGI that benefits all would hand-wring this way about the potential of creating a "catastrophic" disaster. **More on OpenAI:** [*OpenAI Says It’s Fine If ChatGPT Occasionally Accuses Innocent People of Crimes*]() ## Author At Futurism, I've often been drawn to unpacking the narratives that underlie technological, scientific and medical progress, with a special interest in areas of conflict and ambiguity that end up setting agendas and steering the fates of both elites and the hoi polloi. I'm a committed generalist, but I often find myself returning to work involving NASA and the private space sector, the effects of AI on media and society, and the mechanics of the pharmaceutical industry, with a specific focus on the spread of GLP-1 drugs like Ozempic and Wegovy. Prior to Futurism, I worked for publications ranging from Media Matters and Truthdig to Raw Story and Bustle. I'm also the author of "Myspace Scene Queens," a 2024 title in Instar Books' acclaimed "Remember the Internet" series. My work at Futurism has been cited by outlets including the New Yorker, Slate, Nieman Lab, the Verge, the MIT Technology Review, the Sunday Times, and the Daily Beast. I grew up in North Carolina, attended the University of North Carolina at Asheville, and now live in Brooklyn, New York. In my free time, I'm an avid reader and music fan; you can probably find me at a local poetry reading, concert, underground rave, or DJ set. I'm the proud parent of an ineffable orange cat named Mee-Mow. ### Author social links [Bluesky]()