Skip to main content
Search

# LoopSkim

1 related articles

Subscribe to updates
  1. arXiv

    Looped language models no longer wait loop by loop: LoopSkim turns each depth's readout into a verifier, reaching 1.73 times LoopSpec's speedup without training

    Looped language models apply one weight-shared block several times per token, so autoregressive decoding runs every loop of every token in sequence. LoopSkim lets draft tokens read out at shallow depths be checked by each later depth's readout, commits only full-depth readouts, and fixes each position's random draws in advance so decoding stays lossless under sampling. Across five Ouro and Raven models, the untrained version averages 1.73 times LoopSpec's speedup over autoregressive decoding, and an optional draft head raises that ratio to 1.99.

You’re all caught up