#red-teaming

LIVE PULSE

5.0 Anthropic CEO Amodei calls for slower AI development and shared safety rules — 11 src2.7 Agility Robotics unveils Digit 5 humanoid for warehouses and factories — 2 src2.5 Apple ships rebuilt Siri with Google Gemini, but not in the EU — 2 src2.2 Siri AI in macOS 27 Golden Gate: FAQ, Germany availability, privacy questions — 2 src1.8 Sam Altman says OpenAI will not go public in 2026, citing AI safety concerns — 5 src1.4 OpenAI contractors review real ChatGPT conversations to rate responses, report says — 2 src1.4 Anthropic data retention policy prompts firms to limit Claude use for sensitive work — 1 src1.4 VoiceCodeBench arXiv paper proposes benchmark for exact structured-token recovery in speech recognition — 1 src1.4 Arabic-Russian Parallel Corpus and LLM Benchmark for Scientific Text — 1 src1.4 Study Analyzes Self-Reported Limitations in NLP Research — 1 src5.0 Anthropic CEO Amodei calls for slower AI development and shared safety rules — 11 src2.7 Agility Robotics unveils Digit 5 humanoid for warehouses and factories — 2 src2.5 Apple ships rebuilt Siri with Google Gemini, but not in the EU — 2 src2.2 Siri AI in macOS 27 Golden Gate: FAQ, Germany availability, privacy questions — 2 src1.8 Sam Altman says OpenAI will not go public in 2026, citing AI safety concerns — 5 src1.4 OpenAI contractors review real ChatGPT conversations to rate responses, report says — 2 src1.4 Anthropic data retention policy prompts firms to limit Claude use for sensitive work — 1 src1.4 VoiceCodeBench arXiv paper proposes benchmark for exact structured-token recovery in speech recognition — 1 src1.4 Arabic-Russian Parallel Corpus and LLM Benchmark for Scientific Text — 1 src1.4 Study Analyzes Self-Reported Limitations in NLP Research — 1 src

2 curated events

papersTODAY 04:00 UTC

Paper shows harmful tasks can be split across aligned LLMs to evade safety checks

A new arXiv paper describes a method it calls capability laundering, where a less capable, unaligned model breaks a harmful request into seemingly harmless sub-tasks and queries a stronger aligned model on each one separately. Because each individual query looks benign, standard per-interaction safety evaluations do not flag the behavior, but the combined answers reconstruct the original harmful output. The authors argue this exposes a gap in how model safety is currently assessed.

safety/alignment/research/red-teaming

papersSEP 10 04:00 UTC

Black-Box Red Teaming of Agentic AI: A Taxonomy-Driven Framework for Automated Risk Discovery

A new paper presents an automated black-box red teaming framework designed to uncover security risks in agentic AI systems. It uses a structured risk taxonomy to guide systematic testing, addressing the shortfalls of standard single-turn evaluations. The work targets agentic setups where models process untrusted inputs, invoke tools with real permissions, and act autonomously.

agents/security/red-teaming/safety