papersTODAY 04:00 UTC
DA-DLM Models Token Dependencies in Diffusion Language Models
A new arXiv paper introduces DA-DLM, a method for diffusion language models that explicitly captures relationships between tokens during generation. Existing diffusion models denoise masked text by predicting several tokens at once under an assumption of conditional independence, which the authors say weakens coherence. The proposed approach aims to restore those inter-token dependencies.