One-shot pruning found to act as implicit regularizer for speech recognition models
A study argues that one-shot magnitude pruning does more than compress neural networks, acting as an implicit regularizer for automatic speech recognition. Testing with Whisper-small, the authors combine gradient- and Fisher-based sensitivity measures to guide which weights to remove. The work reframes pruning as a training technique rather than only a efficiency tool.