Skip to main content
Search

Reyna Abhyankar

1 related articles

Subscribe to updates
  1. arXiv

    Together Compiler turns inference tuning into a continual loop: up to 2.6x throughput on frontier models, compiled in under 24 hours

    Together AI released Together Compiler (TKCC), which turns optimization of an AI inference engine from a one-off compile into a continual loop driven by agents. Existing agent systems either tune individual kernels on offline benchmarks with low measurement fidelity, or restart the whole engine for every measurement and iterate slowly. TKCC decouples engine startup from forward-pass computation with a tiered persistent engine and adds a cost model for parallelism configurations; it beats hand-written Megakernels on Llama 1B and the best open-source engines on Kimi K3, GLM 5.3, MiniMax M3.1 Flash and DeepSeek v4.1 Flash on the InferenceX benchmark, within 24 hours and at most 2 nodes per model.

You’re all caught up