papersSEP 11 04:00 UTC
REAL-Q: End-to-End LLM Quantization via Dynamic Gradient Descent
A new arXiv paper presents REAL-Q, a post-training quantization method that adjusts a model's compressed weights end-to-end rather than optimizing each layer with its own solver. It replaces the single closed-form second-order solution used by current PTQ techniques with dynamic gradient descent. The work targets cheaper deployment of large language models under tight memory and compute limits.