Token Merging for Multilingual Speech Recognition Studied Across Model Scale
A new arXiv study systematically examines token merging as a way to cut the computational cost of large multilingual speech recognition models such as Whisper. The technique dynamically combines token representations during inference, and the authors test how its effectiveness varies with model size and fine-tuning. The work targets deployment efficiency for transcribing low-resource languages without language-specific training.