Skip to main content
Search

Peter Belcak

1 related articles

Subscribe to updates
  1. arXiv

    Long contexts may be unnecessary: agents that compact their working memory keep long-task accuracy while cloud token costs fall several-fold

    On long-horizon and long-input tasks, frontier language models that repeatedly compact their conversation history into a short state, or store long documents as files and read them on demand, keep task accuracy broadly level with keeping the full history, with small gains or losses in individual settings. Because cloud serving charges by context length, shortening the context cuts estimated cost to a fraction. The authors sketch a semantic state space model (SSSM) that carries only a natural-language state between turns.

You’re all caught up