papersTODAY 04:00 UTC
FLoKD: Federated Low-Rank LLM Distillation Over Wireless Networks
A new arXiv paper introduces FLoKD, a method for fine-tuning large language models across wireless networks without centralizing user data. It combines federated learning with low-rank adaptation and adaptive knowledge distillation to reduce communication and computation costs. The approach targets privacy-preserving deployment of LLMs in distributed, bandwidth-limited settings.