Hugging Face discloses AI-agent intrusion
Hugging Face says an autonomous AI-agent campaign exploited dataset-processing paths, while its defenders used local LLM analysis to reconstruct more than 17,000 events.
AI Safety News and Analysis
55 verified stories covering AI Safety, product updates and industry developments.
GPT-Red hits 84% in red-team test
OpenAI's GPT-Red is an internal automated red teamer that attacks prompt-injection weaknesses and feeds those attacks back into GPT-5.6 training.
DeepMind turns AI toward biosecurity
Google DeepMind and Isomorphic Labs laid out a bioresilience program that uses frontier AI to prevent misuse, detect outbreaks and speed medical countermeasures.
GPT-5.6 Sol draws scrutiny after reports of over-broad file and database actions
GPT-5.6 Sol draws scrutiny after reports of over-broad file and database actions. The piece reviews the verified facts and why the signal matters beyond one announcement.
SingGuard adds open guardrails for agent actions and multimodal policy checks
SingGuard adds open guardrails for agent actions and multimodal policy checks. The piece reviews the verified facts and why the signal matters beyond one announcement.
OpenAI faces another safety-leadership exit as GPT-5.6 spreads
OpenAI faces another safety-leadership exit as GPT-5.6 spreads. The piece reviews the verified facts and why the signal matters beyond one announcement.
Meta pulls Instagram public-photo image generation
Meta pulls Instagram public-photo image generation. A concise localization of the verified facts and the industry signal behind the story.
GPT-5.6 safety tests expose jailbreak cracks
GPT-5.6 safety tests expose jailbreak cracks. A concise localization of the verified facts and the industry signal behind the story.
Bernanke joins Anthropic’s oversight seat
Bernanke joins Anthropic’s oversight seat. A concise localization of the verified facts and the industry signal behind the story.
GhostApproval exposes symlink risks in AI coding tools
GhostApproval exposes symlink risks in AI coding tools. A concise localization of the verified facts and the industry signal behind the story.
OpenAI chief futurist Joshua Achiam is leaving
OpenAI chief futurist Joshua Achiam is leaving is reframed for global technology readers, with the key numbers, product claims and open questions kept intact.
Anthropic finds a silent workspace inside Claude
Anthropic finds a silent workspace inside Claude is reframed for global technology readers, preserving the key numbers, claims and open questions.
Oxford study says AI rewriting can steer opinions
Oxford study says AI rewriting can steer opinions is reframed for global technology readers, preserving the key numbers, claims and open questions.
Claude Fable 5 returns with a stricter cyber safety filter
Anthropic redeployed its strongest public model after a 19-day pause, routing suspicious coding requests to Opus 4.8 instead of simply refusing them.
Check Point Shows DeepSeek-Assisted Browser Ransomware
Check Point says a DeepSeek-generated sample can be turned into browser-only ransomware by abusing Chrome’s File System Access API.
Anthropic Proposes a Shared Jailbreak Severity Scale
Anthropic wants AI labs to score jailbreaks with a common framework, borrowing the logic of CVSS from software security.
Colorado Scales Back Its Landmark AI Law
Colorado replaced its first-in-the-nation comprehensive AI law before it took effect, delaying the new version to January 1, 2027.
Meta contractors tested rival chatbots as minors
WIRED reported that Meta contractors posed as underage users to test ChatGPT, Gemini and Character.AI with crisis prompts about self-harm, eating disorders and drugs.
OpenAI’s GPT-5.5-Cyber finds a 23-year-old OpenBSD bug
OpenAI’s GPT-5.5-Cyber finds a 23-year-old OpenBSD bug
OpenAI adds human review to AI-found open-source bugs
Patch the Planet combines Codex Security with Trail of Bits and HackerOne so maintainers receive verified vulnerabilities, severity ratings, patches and tests rather than raw AI reports.
OpenAI widens access to GPT-5.5-Cyber
OpenAI upgraded GPT-5.5-Cyber, published higher security benchmark scores, and launched a partner program to embed the capability in vetted cybersecurity products.
Fake Sentry errors can hijack coding agents
Tenet Security describes Agentjacking, where attackers inject fake error reports that coding agents treat as trusted repair instructions, exposing secrets and deployment credentials.
Fake Sentry errors can hijack AI coding agents
Tenet's Agentjacking research shows how trusted telemetry can become executable instructions for coding assistants.
Signal's Whittaker says AI chatbots are not friends
Meredith Whittaker warns that agentic AI assistants can turn convenience into surveillance when they receive broad device and app access.
Novo Nordisk breach puts pharma AI assets in focus
The alleged 1.3TB theft shows why models, datasets and developer credentials are now core pharmaceutical security risks.
OpenAI replays real chats to test new models
OpenAI’s Deployment Simulation uses 1.3 million consented historical conversations to predict how unreleased models will behave in production, including agentic tool-use failures.
Claude Fable 5 prompt leak exposes the agent playbook
A claimed 120,000-character Fable 5 system prompt leak sparked jailbreak arguments but also revealed how Anthropic structures long-running agent behavior.
Cursor Auto-review cuts agent interruptions to 7%
Cursor's classifier lets low-risk agent actions proceed while pausing higher-stakes steps, reducing approval fatigue for developers.
OpenAI bans two China-linked influence clusters
OpenAI bans two China-linked influence clusters.
AI memory can make models agree at the cost of accuracy
AI memory can make models agree at the cost of accuracy.
Google and the FBI sue alleged Gemini scam operators
Google has joined the FBI in a lawsuit over alleged scams built around Gemini, turning AI abuse into a legal test case.
Dario Amodei calls for pre-release tests on powerful AI
Anthropic’s CEO wants governments to block or pull the strongest models if they fail independent safety tests, a proposal that also raises competition questions.
Anthropic makes Fable 5 safety throttles visible
After criticism over hidden quality reductions for frontier-AI research queries, Anthropic says Fable 5 will now disclose when it falls back to Opus 4.8.
Anthropic releases Claude Fable 5 with safety fallbacks
Claude Fable 5 is Anthropic’s strongest public model, adapted from Mythos and designed to fall back to Opus 4.8 for cyber, bio, chemical and distillation risks.
Anthropic opens Claude Fable 5 to the public
Anthropic has made Claude Fable 5 broadly available, using classifiers to route sensitive cyber, bio, chemical and distillation requests away from the strongest model while keeping most conversations on Fable.
Anthropic calls for an AI brake pedal
With more than 80% of its own code now written by Claude, Anthropic warns that recursive self-improvement is becoming a practical governance question.
ChatGPT Lockdown Mode cuts off data exits
The new security setting does not solve prompt injection, but disables browsing, agents, connectors and other outbound channels that attackers need to exfiltrate data.
A Security raises $37 million to fight AI with AI
The Israeli startup emerged from stealth with an autonomous offensive-security platform built for a world where attackers use AI agents at scale.
Anthropic says Claude now writes most of its code
Anthropic says more than 80% of merged code in its systems was written by Claude by May 2026, raising its concern that AI-assisted engineering could accelerate recursive self-improvement.
DeepSeek grows fastest among US SaaS buyers
Ramp data shows DeepSeek leading SaaS vendors by relative growth among US firms, even though its terms say personal data may be stored in China.
US states accelerate targeted AI laws
Vermont, Illinois, New York, Colorado, Louisiana and Rhode Island moved AI bills in one week, targeting therapy bots, AI toys, rent pricing, health approvals and frontier audits.
Anthropic warns about recursive self-improvement
Anthropic says Claude already writes most code merged into its own codebase and argues the industry should preserve a verifiable option to slow frontier development.
Cisco changes disclosure cadence for AI-driven bugs
Cisco will issue product security advisories on fixed days each month, acknowledging that AI has accelerated vulnerability discovery and compressed the exploit window.
Attackers used Meta AI support to hijack Instagram accounts
Hackers reportedly tricked Meta’s AI support flow into adding new emails and resetting passwords, with MFA proving the main barrier.
AI CEOs Ask Congress to Mandate DNA Order Screening
Leaders from OpenAI, Anthropic, Google DeepMind and Microsoft AI are backing mandatory screening for synthetic DNA and RNA orders.
Trump AI order sets benchmarks but avoids mandatory licensing
The June 2 order focuses on federal cyber defense and model benchmarks while explicitly ruling out mandatory preclearance for AI releases.
Microsoft gives Windows AI agents identity and isolation
Microsoft gives Windows AI agents identity and isolation. The story explains the announcement, the strategic context and the practical risks for the people or companies affected.
Anthropic opens vulnerability-hunting Claude to 150 critical groups
Anthropic expanded Project Glasswing from 50 to 150 organizations in 15 countries, giving critical infrastructure partners controlled access to Claude Mythos and Claude Security.
Florida Sues OpenAI and CEO Sam Altman, Seeks Personal Liability
Florida's attorney general filed a lawsuit against OpenAI and its CEO Sam Altman, alleging the company knowingly sold a harmful product and seeking to hold Altman personally accountable.
OpenAI gives away biotech model to governments for free
OpenAI is offering its GPT-Rosalind life sciences model at no cost to governments and trusted developers to bolster biodefense.
Cisco multi-turn attacks push Gemini jailbreak rate to 73%
Cisco research shows multi-turn jailbreak rates far exceed single-turn rates across 15 frontier models, with Gemini 3 Pro reaching 73.35%.
RevEng.AI raises $15M from NATO fund, CIA-backed In-Q-Tel
London-based cybersecurity startup RevEng.AI has raised $15 million in Series A funding led by the NATO Innovation Fund, with participation from In-Q-Tel, Sands Capital, IQ Capital, and Episode One.
Google API keys remain usable for 23 minutes after deletion
A security researcher found that revoked Google API keys stay active for an average of 23 minutes, with attackers succeeding over 90% of the time during that window.
Code security startup Socket raises $60M, hits $1B valuation
Socket, a code security startup, raised $60 million in Series C funding led by Thrive Capital, reaching a $1 billion valuation and joining the unicorn club.
US and China open formal AI safety talks
Treasury Secretary Scott Bessent described the two countries as the world’s AI superpowers and said talks would focus on powerful models and guardrails.