papersTODAY 04:00 UTC
Audit Finds Frontier Agents Lose Accuracy When Evidence Is Buried in Documents
A controlled data-room audit tested how frontier models answer questions when supporting evidence sits in hard-to-find locations instead of being directly surfaced. Burying the evidence lowered accuracy while increasing forced declarations, the number of tool calls, and the cost per correct answer. The authors conclude that strong results on shallow document and chart reading tasks can conceal these weaknesses.