Study examines numerical precision limits in Orthrus lossless speculative decoding

A new arXiv paper investigates whether speculative decoding with the Orthrus architecture remains truly lossless when numerical precision is taken into account. Orthrus is a hybrid autoregressive-diffusion system that drafts several tokens at once and verifies them with a frozen autoregressive model, and its claimed exactness depends on the draft and verification steps producing identical results. The work analyzes how floating-point rounding in these computations can break that equivalence in practice.