Long contexts may be unnecessary: agents that compact their working memory keep long-task accuracy while cloud token costs fall several-fold
On long-horizon and long-input tasks, frontier language models that repeatedly compact their conversation history into a short state, or store long documents as files and read them on demand, keep task accuracy broadly level with keeping the full history, with small gains or losses in individual settings. Because cloud serving charges by context length, shortening the context cuts estimated cost to a fraction. The authors sketch a semantic state space model (SSSM) that carries only a natural-language state between turns.