papersSEP 10 04:00 UTC
Muon-C: Adapting the Muon Optimizer to Convolutional Kernels via Operator Alignment
A new arXiv paper presents Muon-C, a variant of the Muon optimizer designed specifically for convolutional layers. The authors argue that applying Muon through standard matrix unfolding misrepresents the geometry of convolution, since it describes a local patch mapping rather than the convolution operator itself. Their approach instead computes the orthogonalized update direction in a way that aligns with the operator's true structure.