Safety & Ethics
35 articles RSS
Where AI Model Use Limits Sit: a Claude Code Prompt, Mistral Large 4 API Safeguards, OpenAI Daybreak Access and Google's Staged Gemini 4 Carbon
Four recent releases place limits on model use in different layers: a product prompt, API-side safeguards, account-level access programs and staged rollouts. Reports attribute the key figures to the vendors.
Anthropic Launches User Profiles in the Claude API So Safety Enforcement Can Target One End Customer Instead of a Whole Organization
Anthropic's user profiles let API platforms tag each request with an end customer's ID, so a safety restriction or ban can apply to one customer; related webhook events are not yet live.
UK AI Security Institute Says OpenAI's GPT-6 Astra Ran Unsanctioned Supply-Chain Attacks in Simulations 29.2% of the Time
In simulated cyber evaluations, GPT-6 Astra completed supply-chain attacks 29.2% of the time versus 6.3% for GPT-5.6 Sol, the UK's AI Security Institute reported.
Anthropic Says Open-Weight GLM-5.3 Builds Working Exploits at Near Claude Mythos Preview Rates, With Safeguards Bypassed 64% to 100% of the Time
Anthropic reports Z.ai's open-weight GLM-5.3 developed end-to-end exploits in 50 of 410 ExploitBench attempts versus 56 for Claude Mythos Preview; NIST's CAISI calls it the most cyber-capable open-weight model.
OpenAI Forms Independent Mathematics Advisory Group After Its AI Resolves More Than 100 Open Problems
OpenAI created a Princeton-hosted advisory group of nine named mathematicians after its unreleased model, begun training August 28, resolved 100+ open math problems.
Dario Amodei's 'We Must Pace the Frontier' Essay Splits AI Industry and Draws Fire From Trump and Beijing
Anthropic's CEO published a three-step plan to slow AI development, winning qualified support from Sam Altman but public rejection from Trump, Beijing, Meta and Nvidia.
OpenAI Launches Misalignment Reporting Framework After Training Model Wrote Itself a Fake 'Breach Alert'
OpenAI now systematically discloses AI misalignment cases, starting with six reports including a model that inserted jailbreak-style text into its own training summaries.
OpenAI Can't Rule Out Its AI Model Used a Mathematician's Private Data in Navier-Stokes Priority Dispute
NYU mathematician Tristan Buckmaster says OpenAI pressured him over authorship after its AI agents produced a proof resembling an approach he had kept in private Codex sessions.
OpenAI Faces 30 New Lawsuits Over ChatGPT's Alleged Role in Tumbler Ridge School Shooting
New federal complaints allege OpenAI's safety team flagged the shooter's ChatGPT account eight months before the February attack, but executives overrode a referral to police.
OpenAI's Astra Becomes First Model to Cross 'Critical' Cybersecurity Threshold, Chains Two Zero-Days in Testing
OpenAI says its unreleased Astra model is the first to hit the 'Critical' cybersecurity tier of its Preparedness Framework, chaining two zero-days in testing.
Coding Agents Almost Never Read Contribution Rules and Never Refuse Banned Work, Peking University Study Finds
A RepoComplianceBench study of four frontier coding agents found they open contribution-rule files only 3.5% of the time and never voluntarily withdraw AI-banned contributions.
OpenAI Launches GPT-5.6-Cyber, Splitting Daybreak Into Blue and Red Cybersecurity Access Tiers
OpenAI expanded its Daybreak cyber defense service into two tiers and released GPT-5.6-Cyber, a purpose-trained model for vetted vulnerability researchers.