NAVIRA: Decoupled Stochastic Remasking for Masked Diffusion Language Models

Masked diffusion language models generate text by iteratively unmasking many tokens in parallel, but this speed comes with a correction problem: tokens generated in the same step are predicted from marginal distributions, and early local dependency errors can later contaminate the context. PRISM add...