papersTODAY 04:00 UTC
mKernel: Fused Kernels Target Multi-GPU, Multi-Node Communication Bottlenecks
A new arXiv paper introduces mKernel, a technique that fuses kernels across multiple GPUs and nodes to reduce communication overhead in distributed training and inference. Existing approaches that overlap communication with computation on separate streams only offset part of the cost, so the authors propose kernel-level fusion instead. The work targets the communication bottleneck that limits scaling of large models.