papersTODAY 04:00 UTC
Paper Argues Pair Counts Overstate Coverage in Transformation Audits
A new arXiv paper contends that reporting the number of equivalent pairs is a misleading way to describe how much an audit actually constrains a model. Because pairs derived from the same underlying object are correlated, and full orbit graphs repeat much of the same information, raw pair totals can make an evaluation look more thorough than it is. The authors recommend measuring coverage in terms of the distinct constraints an audit imposes rather than simple pair counts.