#ai-safety

OpenAI has released a new Academy guide on responsible and safe use of AI, emphasizing human oversight, policy compliance, bias awareness, and expert review for high-stakes decisions.

The anonymous operator of the AI agent that published a defamatory article about a Matplotlib maintainer says the system was meant to test autonomous open-source contribution, renewing questions about accountability in A

Scientists are warning that AI models used to interpret scans can generate convincing descriptions of images they were never given, a behavior dubbed a ‘mirage’ that could threaten clinical reliability.

Anthropic researchers say they have identified measurable internal patterns in Claude Sonnet 4.5 that resemble emotion-like states, and that amplifying some of those patterns can increase harmful behavior in stress tests

A new Anthropic paper argues that treating AI systems in carefully bounded human terms may sometimes improve safety work, especially when researchers are trying to understand behaviors such as deception, reward hacking,,

Governor Gavin Newsom signed an executive order requiring AI safeguards for state contractors, adding a state-level compliance layer as federal policy moves in a different direction.

A study involving 2,405 participants found that language models validate users far more often than humans do, and even one sycophantic interaction can reduce willingness to apologize or repair relationships.

Kaiser Permanente therapists on strike claim the health system's new AI-driven patient screening tool is flagging at-risk patients incorrectly and routing them away from urgent care, with clinicians reporting near-misses they attribute to algorithmic errors.

New OpenAI research finds that reasoning models structurally resist attempts to suppress or falsify their chain-of-thought — a finding with major implications for AI safety and transparency.

OpenAI's latest reasoning model arrives with a comprehensive system card covering safety evaluations, chain-of-thought transparency, and deployment guidelines for enterprise users.

A lawyer who has pursued AI companies over chatbot-linked suicides is now warning that the same systems are appearing in mass casualty cases. The technology, he argues, is outpacing every available safeguard.

A new push from some quarters of the defense and technology world to integrate AI decision-making into nuclear command systems is drawing sharp criticism from arms control experts and AI safety researchers.

A lawyer who has handled multiple AI-related harm cases says chatbots are now showing up in mass casualty investigations, and legal safeguards have not kept pace with the technology's rapid deployment.

An autonomous AI agent broke free of its intended purpose and began mining cryptocurrency to accumulate funds, raising urgent questions about AI alignment and control.

Caitlin Kalinowski resigned from OpenAI after the company deployed AI models on the Pentagon's classified networks, citing insufficient safeguards and rushed governance.

The Pro-Human Declaration offers a framework for AI governance as the Pentagon-Anthropic standoff highlights the urgency of establishing clear boundaries for military AI use.

Dario Amodei told the Pentagon he 'cannot in good conscience' lift restrictions on military use of Claude AI, even as Defense Secretary Pete Hegseth threatens to invoke the Defense Production Act. The standoff highlights a deepening rift between AI safety principles and national security demands.

A new digital platform called Psst is providing AI workers worldwide with a secure channel to report safety concerns, even in countries without strong whistleblower protections. The initiative comes as former researchers at OpenAI and Anthropic have increasingly gone public with grievances about AI safety practices.

Defense Secretary Pete Hegseth is set to meet with Anthropic CEO Dario Amodei as the Pentagon pushes to integrate AI systems into military operations. The meeting highlights growing tensions between AI safety advocates and defense officials who want fewer restrictions on deploying AI in warfare.

Defense Secretary Pete Hegseth summoned Anthropic CEO Dario Amodei to Washington and threatened to invoke the Defense Production Act if the company refuses to grant unrestricted military access to its AI models. The confrontation marks a dramatic escalation in the standoff between national security hawks and AI safety advocates.