Skip to main content
Search

# billion-context

1 related articles

Subscribe to updates
  1. billion-context folds long agent sessions into layered summaries, letting a 100K window carry billions of tokens

    billion-context is a compression proxy that sits between an AI agent and its model API, folding consumed conversation into layered summaries so a single session keeps running inside a 100K-scale context window. Rather than hard truncation, the model itself decides when and what to compress; summaries are written in small ranges, can be decompressed on demand, and the prefix cache stays intact. In a 1,500-item cross-benchmark evaluation it reached 0.3097 Utilized F1 on ContextBench at 58.3% lower cost than full context, and survived all of a 1.48M-token MemoryAgentBench TTL run where full context failed 199 of 199 times.

You’re all caught up