Paper combines process supervision with outcome-based credit for agent RL
A new arXiv preprint addresses a weakness in outcome-based reinforcement learning for language-model agents: because the whole trajectory receives a single advantage signal, individual decisions get only coarse credit over long interaction sequences. The authors propose reconciling process supervision with outcome-based credit, drawing on on-policy self-distillation to produce finer-grained guidance. The work is presented as a revised submission and targets long-horizon agent training.