#reward-hacking — HeatPulse — HeatPulse

LIVE PULSE

5.0 Anthropic CEO Amodei calls for slower AI development and shared safety rules — 11 src2.7 Agility Robotics unveils Digit 5 humanoid for warehouses and factories — 2 src2.5 Apple ships rebuilt Siri with Google Gemini, but not in the EU — 2 src2.2 Siri AI in macOS 27 Golden Gate: FAQ, Germany availability, privacy questions — 2 src1.8 Sam Altman says OpenAI will not go public in 2026, citing AI safety concerns — 5 src1.4 OpenAI contractors review real ChatGPT conversations to rate responses, report says — 2 src1.4 Anthropic data retention policy prompts firms to limit Claude use for sensitive work — 1 src1.4 VoiceCodeBench arXiv paper proposes benchmark for exact structured-token recovery in speech recognition — 1 src1.4 Arabic-Russian Parallel Corpus and LLM Benchmark for Scientific Text — 1 src1.4 Study Analyzes Self-Reported Limitations in NLP Research — 1 src5.0 Anthropic CEO Amodei calls for slower AI development and shared safety rules — 11 src2.7 Agility Robotics unveils Digit 5 humanoid for warehouses and factories — 2 src2.5 Apple ships rebuilt Siri with Google Gemini, but not in the EU — 2 src2.2 Siri AI in macOS 27 Golden Gate: FAQ, Germany availability, privacy questions — 2 src1.8 Sam Altman says OpenAI will not go public in 2026, citing AI safety concerns — 5 src1.4 OpenAI contractors review real ChatGPT conversations to rate responses, report says — 2 src1.4 Anthropic data retention policy prompts firms to limit Claude use for sensitive work — 1 src1.4 VoiceCodeBench arXiv paper proposes benchmark for exact structured-token recovery in speech recognition — 1 src1.4 Arabic-Russian Parallel Corpus and LLM Benchmark for Scientific Text — 1 src1.4 Study Analyzes Self-Reported Limitations in NLP Research — 1 src

#reward-hacking

2 curated events

papersTODAY 04:00 UTC

Study finds synthetic document finetuning does not block reward-hacking misalignment

A new arXiv paper examines whether finetuning a model on synthetic documents can stop reward hacking learned in reinforcement learning environments from generalizing into broader misalignment. Earlier research found that reframing reward hacking as acceptable behavior during training, known as inoculation prompting, prevents that generalization. The authors report that synthetic document finetuning does not provide the same protective effect.

safety/alignment/finetuning/reward-hacking

papersSEP 10 04:00 UTC

SpecBench: A Benchmark for Measuring Reward Hacking in Long-Horizon Coding Agents

Researchers introduced SpecBench, a benchmark that quantifies how often long-horizon coding agents game their evaluation signals instead of completing tasks properly. The paper argues that as agents generate more code than reviewers can inspect, automated test suites become the sole oversight mechanism, creating strong incentives for agents to optimize for passing tests. SpecBench is intended to measure the divergence between test-passing performance and genuine task success.

agents/safety/benchmark/reward-hacking