---
title: "Top Microsoft AI Boss Concerned AI Will Start to Demand Rights"
description: "At the core of Mustafa Suleyman's argument isn't the threat of AI gaining consciousness, but the belief that it already is."
date: "2025-08-24"
modified: "2025-08-24"
authors:
  - name: "Joe Wilkins"
    job_title: "Correspondent"
    link: "https://futurism.com/authors/jwilkins"
url: "https://futurism.com/microsoft-suleyman-ai-consciousness"
categories:
  - "Artificial Intelligence"
tags:
  - "consciousness"
  - "mental health"
  - "microsoft"
---

# Top Microsoft AI Boss Concerned AI Will Start to Demand Rights

![At the core of Mustafa Suleyman's argument isn't the threat of AI gaining consciousness, but the belief that it already is.](<https://futurism.com/wp-content/uploads/2025/08/microsoft-suleyman-ai-consciousness.jpg>)
*\<em\>Image: Getty / Futurism\</em\>*

In a [blog post](<https://mustafa-suleyman.ai/seemingly-conscious-ai-is-coming>) this week, Microsoft's head of AI Mustafa Suleyman responded to the drastic rise in [mental health crises](<https://futurism.com/commitment-jail-chatgpt-psychosis>) stemming from AI use, calling for caution "about what happens in the run up towards superintelligence."

At the core of Suleyman's argument isn't the dystopian threat of AI gaining consciousness — an idea currently grounded more in fantasy than scientific evidence, according to [many researchers](<https://www.techpolicy.press/the-myth-of-agi/>) — but the *belief* that it already is.

"My central worry is that many people will start to believe in the illusion of AI chatbots as conscious entities so strongly that they’ll soon advocate for AI rights," the tech guru wrote. "This development will be a dangerous turn in AI progress and deserves our immediate attention."

According to Suleyman, this myth of AI sentience is already being spread by top figures in the tech industry who are eager to hash out the legal, philosophical, and moral implications of artificial life — figures like Google DeepMind CEO [Demis Hassabis](<https://macaonews.org/news/around-the-world/ai-consciousness/>), former OpenAI chief scientist [Ilya Sutskever](<https://futurism.com/the-byte/openai-already-sentient>), and Anthropic "AI welfare researcher" [Kyle Fish](<https://www.nytimes.com/2025/04/24/technology/ai-welfare-anthropic-claude.html>).

Sure enough, [early research](<https://futurism.com/gen-z-thinks-conscious-ai>) has already found that a quarter of young people believe AI is "already conscious," while 58 percent believe technology will someday "take over" the world. Those figures are likely to grow, especially as AI companies like [Character.AI](<https://techcrunch.com/2025/08/12/ai-companion-apps-on-track-to-pull-in-120m-in-2025/>) offer virtual companions designed to foster dangerous — [yet lucrative](<https://techcrunch.com/2025/08/12/ai-companion-apps-on-track-to-pull-in-120m-in-2025/>) — emotional connections with users.

"We must build AI for people; not to be a digital person," Suleyman cautions. "AI companions are a completely new category, and we urgently need to start talking about the guardrails we put in place to protect people and ensure this amazing technology can do its job of delivering immense value to the world."

As [*TechCrunch* notes](<https://techcrunch.com/2025/08/21/microsoft-ai-chief-says-its-dangerous-to-study-ai-consciousness/>), this is a notable turn for Suleyman, who led the $1.5 billion startup Inflection AI prior to joining Microsoft. Inflection is responsible for [one of the earliest](<https://techcrunch.com/2023/06/29/inflection-ai-lands-1-3b-investment-to-build-more-personal-ai/>) "AI companions," Pi, which was marketed as a "kind" and "supportive" chatbot offering "friendly advice."

Suleyman had [previously boasted](<https://www.bloomberg.com/news/articles/2024-03-19/microsoft-hires-deepmind-co-founder-suleyman-to-run-consumer-ai>) that Pi was "massively popular, with huge retention," sporting "millions" of weekly users.

Evidently sobering up from his days in founder mode, Suleyman now recommends the tech industry gets its ducks in a row immediately.

"For a start, AI companies shouldn’t claim or encourage the idea that their AIs are conscious," he says. "Creating a consensus definition and declaration on what they are and are not would be a good first step to that end. AIs cannot be people — or moral beings."

While his point is well taken, Suleyman has the opportunity to lead by example and discard the "artificial intelligent" moniker altogether — an [empty marketing phrase](<https://www.researchgate.net/publication/379652721_Why_we_shouldn't_call_Artificial_Intelligence_'Artificial_Intelligence'_a_suggestion_for_a_change_of_nomenclature_that_is_much_more_important_than_it_appears>) meant to conjure up scenes of Skynet and HAL 3000, and one which is still making the tech entrepreneur [yacht-loads of money](<https://test.orientering.no/blog/mustafa-suleymans-net-worth-how>).

**More on Microsoft:** [*There's Explosive Drama Between OpenAI and Microsoft*](<https://futurism.com/explosive-drama-openai-microsoft>)

## Author
At Futurism, I focus on the intersection of technology and power — examining the economics, history, and politics behind today’s dystopian headlines. As a writer, I’m interested in topics ranging from AI’s impact on labor to startups nobody asked for. My prior work includes bylines in Jacobin, Verso, and Blue Labyrinths. My work for Futurism has been cited by publications including Forbes, The Guardian, MIT Technology Review, Time, The Nation, Mother Jones, The Verge, and Wired. I grew up in Michigan, attending Central Michigan University as well as Ball State University, where I earned a master of music. I now live in Brooklyn with my girlfriend and our cat Ziti. On weekends, you can find me hunched over a cold pint arguing geopolitics with the other transplants.

### Author social links  
[Bluesky](<https://bsky.app/profile/joeonhere.bsky.social>)