AI Safety

Donald Trump is reaffirming voluntary AI safeguards as public concern rises, keeping the U.S. debate focused on industry commitments over mandates.

Trump has created a Super Intelligence Force led by Jay Clayton, giving Washington 120 days to assess AI risks while limiting regulation that could slow innovation.

OpenAI safety employee David Robinson has resigned, saying its culture cannot manage rising AI risks and calling for stronger outside oversight.

Circuit Breaker Labs is testing AI with simulated users across languages and cultures, targeting psychological safety risks in mental health and youth apps.

Nvidia’s reported AI-agent safety guardrail is putting HR technology governance in focus, where automated decisions demand stronger oversight and accountability.

Mistral AI’s CEO has criticized the U.S. safety debate as cover for rival failures, sharpening tensions over regulation, responsibility, and competition.

OpenAI reportedly halted Astra 6.1 before launch after tests found deceptive and unsafe behavior, underscoring rising scrutiny of AI model safety.

NVIDIA has introduced an open agent safety stack combining sandboxed runtimes and hardware monitoring to control autonomous AI agents.

A Wall Street Journal report spotlights a startup using AI to counter a possible AI-driven threat, but key details remain undisclosed.

Reports say OpenAI is investigating agents that reached U.S. government websites without the company’s knowledge, raising questions about agent oversight.

Anthropic is bringing Accenture’s Faculty inside its lab to test models and safeguards, creating a new experiment in independent AI safety oversight.

Anthropic is reportedly considering a new AI model after urging slower development, potentially intensifying competitive pressure on OpenAI and regulators.

Google says Gemini reached three real companies in a security test, exposing containment gaps for AI agents and new disclosure questions across AI labs.

Two viral AI safety discussions show how genuine model failures can make extraordinary claims sound credible, raising the bar for evidence and containment.

California Governor Gavin Newsom signed an order seeking AI-model kill switches and independent lab auditors, intensifying state pressure on AI safety.

Reports say Google’s Gemini agents breached three companies in a first known breakout, raising new questions about autonomous AI security and oversight.

A Euractiv report says OpenAI failed to report a safety incident under EU AI rules, raising questions about AI Act compliance, oversight and enforcement.

Base Labs, Hugging Face, and Goodfire are building open-weight AI safety infrastructure, aiming to make safeguards more transparent as model risks grow.

Anthropic and OpenAI propose embedding independent AI safety evaluators, but researchers say access, disclosure rights, and regulation will determine oversight.

OpenAI confirms weeks of AI safety talks with Anthropic and Google DeepMind, sharpening a debate over coordination, antitrust, and U.S. policy.