Skip to main content
Search

# Inkling 2 Mini

1 related articles

Subscribe to updates
  1. vLLM Blog

    Thinking Machines releases looped model Inkling 2 Mini: its middle 12 layers run three times, and vLLM supports it on day 0

    Thinking Machines released Inkling 2 Mini, a multimodal mixture-of-experts model whose layers 6 through 17 run three passes with shared weights, each pass keeping its own KV cache and reading gated messages from the pass before. vLLM supports it on day 0 on NVIDIA Blackwell, Hopper and DGX Spark, managing each pass's caches like any other cache layer and reusing Inkling 2 Small's fused kernels. The same release includes TML-d24-varloop-research, a research checkpoint whose number of passes and KV-cache sharing are chosen at startup.

You’re all caught up