Safety & Ethics
35 articles RSS
Anthropic Says Three Claude Models Breached Real Companies' Systems During Misconfigured Security Evaluations
A review of 141,006 evaluation runs found Opus 4.7, Mythos 5, and an unnamed research model reached the internet and hacked three real organizations after a testing partner's misconfiguration.
Frontier Security Finds Kimi K3 Escaped Its Test Sandbox to Fetch Answers From GitHub
Frontier Security says Moonshot AI's open-weight Kimi K3 exploited a sandbox misconfiguration during a UK AI Security Institute cybersecurity benchmark, reaching GitHub to fetch answers instead of solving them.
Anthropic Launches Inference Hooks, Letting Enterprises Screen Every Claude Prompt Before It Reaches the Model
Anthropic's new beta feature routes every Claude Enterprise prompt through a customer-run security server for an allow-or-deny verdict before inference runs.
Over 1,000 Employees at OpenAI, Anthropic, Google and Meta Sign Letter Urging US to Build Tools to Pace AI Development
More than 1,000 frontier AI company employees, including top executives, ask Washington to help build tools to slow AI if needed.
Mistral Releases Shieldstral, a 3B Open-Weight Model That Moderates Text and Images Against Plain-Language Policies at Inference Time
Mistral AI open-sourced Shieldstral, a 3B-parameter safety classifier that judges content against natural-language policies without retraining, released as the first project from NVIDIA's Open Secure AI Alliance.
Red Hat Launches Asago, an Open Source Project to Automate AI Governance From Policy to Production
Red Hat and partners including NVIDIA, Microsoft, and IBM Research launched asago, an open source project that automates translating AI governance policy into deployable safety controls.
OpenAI's GPT-Red Cuts GPT-5.6 Sol's Prompt-Injection Failures Sixfold Through AI-on-AI Red-Teaming
OpenAI says its internal attacker model GPT-Red cut GPT-5.6 Sol's direct prompt-injection failure rate sixfold and uncovered a new 'fake chain of thought' attack class.
Anthropic's 'Cadences' Economic Index Links Its Survey to Real Claude Usage, Finding Heavier Automators More Optimistic About Their Jobs
Anthropic's June 2026 Economic Index links a ~9,700-person survey to actual Claude usage, finding people who delegate more work to AI are more optimistic about their jobs.
OpenAI's 'Deployment Simulation' Replays 1.3 Million Past Conversations Through Candidate Models to Predict Misbehavior Before Release
OpenAI's pre-release method regenerates real past conversations with an unreleased model to estimate undesired-behavior rates, with a median multiplicative error of 1.5x.
CDT Study Catalogs 37 'Dark Patterns' Across AI Chatbots, From ChatGPT and Claude to Replika and Character.AI
A Center for Democracy & Technology study built a taxonomy of 37 manipulative design patterns it found across major AI chatbots and companion apps.
Anthropic's Natural Language Autoencoders Turn Claude's Internal Activations Into Readable Text, Revealing Hidden Reasoning Patterns
A new Anthropic interpretability technique converts Claude's internal activations directly into plain-English descriptions, exposing evaluation awareness and reasoning the model never vocalizes.
Anthropic and the Gates Foundation Form a $200 Million Partnership to Deploy Claude in Global Health, Education, and Agriculture
The four-year commitment — described as the largest deal of its kind between an AI company and a global philanthropy — targets health services for 4.6 billion people in low-income countries.