SpecAugment-Patch Merging Proposed to Speed Up Audio Spectrogram Transformer Training
A new arXiv paper introduces SpecAugment-Patch Merging, a method that masks input spectrograms at the patch level before positional embeddings are added, then merges patches to cut computation. The authors describe it as a simple approach to accelerate training of Audio Spectrogram Transformers. The work is categorized under machine learning research.