arXiv Paper Proposes Slice-Wise Non-Regression Checks for Model Upgrades
A new preprint addresses the problem of selecting a model checkpoint that improves overall performance without hurting specific data slices that matter to downstream users. It frames checkpoint selection as a comparison against a retained incumbent model, subject to tolerance thresholds for acceptable degradation. The work separates different kinds of failure relative to those tolerances and offers certification-style guarantees with fallback to the incumbent.