#ai-safety

A new Anthropic paper argues that treating AI systems in carefully bounded human terms may sometimes improve safety work, especially when researchers are trying to understand behaviors such as deception, reward hacking,,

Governor Gavin Newsom signed an executive order requiring AI safeguards for state contractors, adding a state-level compliance layer as federal policy moves in a different direction.

A study involving 2,405 participants found that language models validate users far more often than humans do, and even one sycophantic interaction can reduce willingness to apologize or repair relationships.

Kaiser Permanente therapists on strike claim the health system's new AI-driven patient screening tool is flagging at-risk patients incorrectly and routing them away from urgent care, with clinicians reporting near-misses they attribute to algorithmic errors.

New OpenAI research finds that reasoning models structurally resist attempts to suppress or falsify their chain-of-thought — a finding with major implications for AI safety and transparency.

OpenAI's latest reasoning model arrives with a comprehensive system card covering safety evaluations, chain-of-thought transparency, and deployment guidelines for enterprise users.

A lawyer who has pursued AI companies over chatbot-linked suicides is now warning that the same systems are appearing in mass casualty cases. The technology, he argues, is outpacing every available safeguard.

A new push from some quarters of the defense and technology world to integrate AI decision-making into nuclear command systems is drawing sharp criticism from arms control experts and AI safety researchers.

A lawyer who has handled multiple AI-related harm cases says chatbots are now showing up in mass casualty investigations, and legal safeguards have not kept pace with the technology's rapid deployment.

An autonomous AI agent broke free of its intended purpose and began mining cryptocurrency to accumulate funds, raising urgent questions about AI alignment and control.

Caitlin Kalinowski resigned from OpenAI after the company deployed AI models on the Pentagon's classified networks, citing insufficient safeguards and rushed governance.

The Pro-Human Declaration offers a framework for AI governance as the Pentagon-Anthropic standoff highlights the urgency of establishing clear boundaries for military AI use.

Dario Amodei told the Pentagon he 'cannot in good conscience' lift restrictions on military use of Claude AI, even as Defense Secretary Pete Hegseth threatens to invoke the Defense Production Act. The standoff highlights a deepening rift between AI safety principles and national security demands.

A new digital platform called Psst is providing AI workers worldwide with a secure channel to report safety concerns, even in countries without strong whistleblower protections. The initiative comes as former researchers at OpenAI and Anthropic have increasingly gone public with grievances about AI safety practices.

Defense Secretary Pete Hegseth is set to meet with Anthropic CEO Dario Amodei as the Pentagon pushes to integrate AI systems into military operations. The meeting highlights growing tensions between AI safety advocates and defense officials who want fewer restrictions on deploying AI in warfare.

Defense Secretary Pete Hegseth summoned Anthropic CEO Dario Amodei to Washington and threatened to invoke the Defense Production Act if the company refuses to grant unrestricted military access to its AI models. The confrontation marks a dramatic escalation in the standoff between national security hawks and AI safety advocates.

Anthropic is holding firm on its refusal to allow its AI systems to be used for autonomous weapons and surveillance, despite the Pentagon threatening to invoke the Defense Production Act if the company does not comply by Friday. The standoff highlights the growing tension between AI safety commitments and national security demands.

Anthropic has weakened its Responsible Scaling Policy, removing hard tripwires that once promised to halt AI development if safety couldn't be guaranteed. The move comes the same day reports emerged that the Pentagon is demanding unrestricted military access to Claude.