papersSEP 10 04:00 UTC
Study Examines Decision Shifts and Grounding in Correctness-Gated Multi-Teacher Distillation
A new arXiv paper in cs.AI reports a controlled comparison of eight correctness-gated multi-teacher distillation setups, all sharing the same data sources and a 63.9-million-parameter student model. The authors argue that achieving correct candidate decisions is a different objective from keeping model rationales grounded, and their audit of grounding ended inconclusive. The experiments also documented shifts in decisions and a loss of label functionality across the tested configurations.