papersTODAY 04:00 UTC
Adaptive Phase-Switching Method Targets Communication Costs in Federated LoRA Tuning
A new arXiv paper proposes adaptively switching between training phases to reduce the communication overhead of federated fine-tuning with low-rank adaptation. The authors argue that existing accounting methods for federated LoRA protocols overlook asymmetric transit costs between clients and the server. Their approach aims to make the dominant per-round communication expense more efficient while keeping trainable parameters small on each client.