papersTODAY 04:00 UTC
TestHallVQA benchmark probes document-level reasoning in vision-language models
A new arXiv paper introduces TestHallVQA, a benchmark built from scientific exam material for evaluating large vision-language models on visual question answering over long, multi-page documents. The authors argue that current planar VQA benchmarks tend to test isolated skills rather than document-level reasoning amid redundant context. The benchmark is intended to expose where such models fail when relevant information is buried in lengthy inputs.