Diffusion Based Language Models

Traditional language models (like GPT) create text one word or token at a time, from left to right. Think of it like writing a sentence sequentially. These are called autoregressive models (ARMs).