Skip to main content
Search

# Random Sequential Adsorption

1 related articles

Subscribe to updates
  1. arXiv

    Masked diffusion's parallel decoding gets an exact solution: generation becomes random sequential adsorption, and long-range text still pays in perplexity

    Masked diffusion models reveal many tokens in parallel, and the price is an error, because tokens revealed together are drawn independently. For text generated by a Markov chain, generation maps onto random sequential adsorption with labelled gaps, whose statistics obey a closed linear master equation, giving the path error and output statistics exactly for any number of steps, sequence length and schedule. For many steps the error becomes a thermodynamic metric whose geodesics are optimal schedules; longer correlations concentrate the error at the start of generation, so schedules that start with small steps gain more.

You’re all caught up