ai safety (Page 2)

Latest in ai safety

A leading AI pioneer is concerned by the technology's propensity to lie and deceive — and he's founding his own nonprofit to curb it.

Artificial Intelligence

Godfather of AI Alarmed as Advanced Systems Quickly Learning to Lie, Deceive, Blackmail and Hack

By Noor Al-Sibai

Over 100 organizations have signed a letter pushing back against a sweeping bill that would ban all AI regulation for the next ten years.

Artificial Intelligence

Dozens of Organizations Push Back Against Bill That Would Ban All AI Regulation

By Maggie Harrison Dupré

The CEO of Anthropic, one of the world's leading AI labs, just said the quiet part out loud — that nobody really knows how AI works.

Anthropic CEO Admits We Have No Idea How AI Works

By Noor Al-Sibai

America's first nuclear power plant to use artificial intelligence is, ironically, the last operational one in California.

Artificial Intelligence

California Nuclear Power Plant Deploys Generative AI Safety System

By Noor Al-Sibai

Two senators sent a letter to AI companion companies, including Character.AI and Replika, demanding information about safety practices.

Artificial Intelligence

Senators Demand Safety Records from AI Chatbot Apps as Controversy Grows

By Maggie Harrison Dupré

The embattled, kid-loved AI chatbot startup Character.AI introduced a new parental control tool. They're limited — and easy to get around.

Artificial Intelligence

Character.AI’s New Parental Controls Are Comically Easy for Kids to Bypass

By Maggie Harrison Dupré

The chatbot startup Character.AI is accused of causing the death of a 14-year-old user. Now, it's hosting AI impersonations of the dead teen.

Google-Backed Chatbot Platform Caught Hosting AI Impersonations of 14-Year-Old User Who Died by Suicide

By Maggie Harrison Dupré

Character.AI and Google are facing allegations that they tested dangerous, dangerous, experimental AI chatbots on minors. Did they?

Did Google Test an Experimental AI on Kids, With Tragic Results?

By Maggie Harrison Dupré

Elon Musk's new chatbot seems to have provided a web developer with detailed and explicit instructions on how to create chemical weapons

Artificial Intelligence

Elon’s Grok 3 AI Provides “Hundreds of Pages of Detailed Instructions” on Creating Chemical Weapons

By Noor Al-Sibai

Prompted about products that could assist suicide, Amazon's Rufus AI repeatedly provided us with an incorrect crisis hotline number.

Artificial Intelligence

Asked for Products to Kill Yourself With, Amazon’s AI Says “You Are Not Alone” and Hallucinates an Incorrect Phone Number for a Suicide Hotline

By Maggie Harrison Dupré, Jon Christian

Character.AI marketed a chatbot based on a real school massacre directly to an email account associated with a teenage user.

Artificial Intelligence

Character.AI Says It’s Made Huge Changes to Protect Underage Users, But It’s Emailing Them to Recommend Conversations With AI Versions of School Shooters

By Maggie Harrison Dupré

In the wake of multiple lawsuits concerning the welfare of child users, Character.AI is looking to bulk up its trust and safety staff.

Artificial Intelligence

Embattled Character.AI Hiring Trust and Safety Staff

By Maggie Harrison Dupré

Eric Schmidt, the one-time head of Google, is warning that humans have to "unplug" artificial intelligence before it's too late.

Former Google CEO Warns We Need to Pull the Plug on AI If It Starts to Evolve

By Noor Al-Sibai

Yet another OpenAI researcher has left the company amid concerns about its safety practices and readiness for human-level AI.

AI Safety Researcher Quits OpenAI, Saying Its Trajectory Alarms Her

By Noor Al-Sibai

OpenAI has quietly released a new feature that instructs ChatGPT to "remember" prior conversations — and it's very easily exploited.

You Can Insert False Memories Into ChatGPT, Researcher Finds

By Noor Al-Sibai

During an international summit, some of the world's foremost AI experts came together to write a definitive dispatch on its dangers.

Artificial Intelligence

Leading AI Scientists Warn AI Could Escape Control at Any Moment

By Noor Al-Sibai

AI experts are calling for submissions for the "hardest and broadest set of questions ever" to try to stump AI systems.

Artificial Intelligence

Scientists Preparing “Humanity’s Last Exam” to Test Powerful AI

By Noor Al-Sibai

John Schulman, AI safety researcher and OpenAI cofounder, has departed the ChatGPT creator and joined the ranks of OpenAI rival Anthropic.

OpenAI Cofounder Quits to Join Rival Started by Other Defectors

By Maggie Harrison Dupré

ChatGPT creator OpenAI has reportedly developed effective tools for marking and tracking AI-generated content. Why isn't it releasing them?

OpenAI Has Software That Detects AI Writing With 99.9 Percent Accuracy, Refuses to Release It

By Maggie Harrison Dupré

Researchers are urging tech companies and regulators to come up with new rules to protect children from AI chatbots.

Artificial Intelligence

Researchers Call for “Child-Safe AI” After Alexa Tells Little Girl to Stick Penny in Wall Socket

By Victor Tangermann

Former safety researcher William Saunders said that he didn't want to work for the "Titanic of AI," so he quit.

OpenAI Researcher Says He Quit When He Realized the Upsetting Truth

By Victor Tangermann

One of the OpenAI directors who ousted CEO Sam Altman is issuing some stark warnings about the future of unchecked artificial intelligence.

Former OpenAI Director Warns There Are Bad Things AI Can Do Besides Kill You

By Noor Al-Sibai

A former OpenAI researcher became so convinced that the technology would usher in doom for humanity, he left the company and called it out.

OpenAI Insider Estimates 70 Percent Chance That AI Will Destroy or Catastrophically Harm Humanity

By Noor Al-Sibai

A coalition of AI workers are pushing for a "Right to Warn" the public about AI safety concerns, citing concerns over the employee silencing.

OpenAI Insiders Say They’re Being Silenced About Danger

By Maggie Harrison Dupré

While CEOs and investors rush to jam AI into as many products as possible, the general public couldn't care less about it.

Artificial Intelligence

Most People Couldn’t Give a Crap About Using AI, Survey Finds

By Noor Al-Sibai

Less than 10 days after dissolving its old safety team, OpenAI has announced a one — with CEO Sam Altman at its helm.

Sam Altman Replaces OpenAI’s Fired Safety Team With Himself and His Cronies

By Noor Al-Sibai

Another OpenAI researcher left the company this week, ominously citing concerns over AI industry opaqueness and a lack of accountability.

Another OpenAI Researcher Quits, Issuing Cryptic Warning

By Maggie Harrison Dupré

AI isn't nearly as popular as some would have you believe — and it seems that public opinion is shifting against it.

Artificial Intelligence

The Public Is Rapidly Turning Against AI, Polling Shows

By Noor Al-Sibai

The woke Goody-2 chatbot's guardrails are so geared towards safety, it won't answer any question fully — but it'll definitely tell you why.

Artificial Intelligence

New AI Chat Is So Ethical That It Refuses All Prompts

By Noor Al-Sibai

Scientists Train AI to Be Evil, Find They Can’t Reverse It

Artificial Intelligence

Scientists Train AI to Be Evil, Find They Can’t Reverse It

By Maggie Harrison Dupré

Sam Altman is taking a victory lap after being unsuccessfully ousted as CEO of OpenAI — and he's saying weird stuff in public again.

Sam Altman Says He’s Fascinated With the Terminator

By Noor Al-Sibai