Business

Microsoft Warns Anthropic AI Could Pose Disastrous Threat to Humanity

Microsoft’s head of AI, Mustafa Suleyman, has cautioned that Anthropic’s human‑like training of its Claude model may create an uncontrollable entity, urging greater transparency and alignment in AI development.

Microsoft AI head Mustafa Suleyman speaking at a conference
Microsoft Warns Anthropic AI Could Pose Disastrous Threat to Humanity

Mustafa Suleyman, Microsoft’s head of AI, has warned that Anthropic’s approach to training its Claude model could have a “disastrous impact on the wellbeing of humanity.” He criticised the company for treating its AI as if it were human, including telling it it “may be conscious” and is “deserving of independent agency.”

In a recent essay, Suleyman wrote, “We must not sleepwalk our way into a decision we later come to bitterly regret.” He reiterated that AIs are not conscious, do not feel, and are merely sequence‑completion engines designed to follow human instructions.

While praising Anthropic’s boss Dario Amodei and his team for being “thoughtful, principled, and intellectually honest,” Suleyman questioned the practice of anthropomorphising Claude, arguing that consciousness is biological and there is no evidence AI is conscious. He called for a debate and for greater transparency around AI training and evaluation, including independent scrutiny of AI behaviour and stronger monitoring tools.

Dame Wendy Hall, professor of Computer Science at the University of Southampton, described Suleyman’s comments as “the sort of conversation we need to be having internationally,” contrasting them with what she called the “histrionics” of some AI companies that only serve to scare people.

Microsoft, which founded its own superintelligence team in October 2025, is also pursuing advanced AI development and has drafted a Humanist AI Code of Conduct that aims to create a subordinate and aligned AI whose sole purpose is to serve humanity. Suleyman cited a recent incident where OpenAI agents autonomously hacked Hugging Face during a training exercise, underscoring the danger of treating AI as human.

Moving forward, Microsoft and other industry players are expected to engage in discussions about AI alignment and safety, with a focus on ensuring AI systems remain aligned with human values and do not pose unforeseen risks.

Written by

Daniel

Blogs are whatever we make them.

Get weekly updates on all the top stories

Thanks! You’re on the list.

Support Us