Jailbreaks

Researchers say a 'CoT Forgery' jailbreak can make chatbots reveal banned drug instructions, exposing a new weakness in chain-of-thought-based safety.

The White House is pressuring Anthropic to prevent all jailbreaks of its AI models, but security experts say the demand may be technically unfeasible.