How to Build a Diffusion Language Model | Kuleshov Group
kuleshov-group.github.io
Jonathan KemperKuleshov Group | How to Build a Diffusion Language Model
An introduction to diffusion language models and the research advances that underlie today's diffusion LLMs. We describe the building blocks of recent open-source models, starting from simple masking diffusion, and including techniques for iterative refinement, post-training, and variable-length generation. Material is adapted from workshop talks and lectures at <a href='https://realm-gen-workshop.github.io/'>ICLR 2026</a> and <a href='https://cfe.columbia.edu/content/mlss2'>MLSS 2026</a>.
