Skip to main content
Search

Guannan Lai

2 related articles

Subscribe to updates
  1. arXiv

    RouteFM turns LLM routing into a reusable pretrained capability, beating the strongest baseline by 2.23 quality points on the unseen multimodal MMR-Bench with only eight observations per candidate

    The work introduces RouteFM, reframing large language model routing from environment-specific local fitting into a pretrain-once, route-anywhere foundation-model paradigm: episodic pretraining across heterogeneous routing environments learns a reusable, target-conditioned candidate-comparison capability in which candidates are represented only by anonymous behavioral evidence (historical query embeddings, observed quality, normalized relative cost) with no model names or identity embeddings, and at inference the router stays frozen while adapting to new domains, modalities, candidate pools, and smaller context budgets through context alone, outperforming the strongest non-RouteFM baseline by 2.23 quality points on the pretraining-excluded MMR-Bench with eight observations per candidate.

  2. arXiv

    SaveRouter Cuts LLM Routing's Break-Even Deployment Volume by Up to About 9.5x Using Roughly a Third of the Supervision

    The work proposes SaveRouter, a sparse-supervision routing framework that selectively acquires informative query-model feedback and shares capability information across related queries, using only about 33-41% of available training feedback across four routing benchmarks while maintaining competitive or better routing quality and reducing the break-even deployment volume by roughly 1.9-9.5x relative to the fastest conventional fully supervised router.

You’re all caught up