Skip to main content
Search

# RouteFM

1 related articles

Subscribe to updates
  1. arXiv

    RouteFM turns LLM routing into a reusable pretrained capability, beating the strongest baseline by 2.23 quality points on the unseen multimodal MMR-Bench with only eight observations per candidate

    The work introduces RouteFM, reframing large language model routing from environment-specific local fitting into a pretrain-once, route-anywhere foundation-model paradigm: episodic pretraining across heterogeneous routing environments learns a reusable, target-conditioned candidate-comparison capability in which candidates are represented only by anonymous behavioral evidence (historical query embeddings, observed quality, normalized relative cost) with no model names or identity embeddings, and at inference the router stays frozen while adapting to new domains, modalities, candidate pools, and smaller context budgets through context alone, outperforming the strongest non-RouteFM baseline by 2.23 quality points on the pretraining-excluded MMR-Bench with eight observations per candidate.

You’re all caught up