The work introduces RouteFM, reframing large language model routing from environment-specific local fitting into a pretrain-once, route-anywhere foundation-model paradigm: episodic pretraining across heterogeneous routing environments learns a reusable, target-conditioned candidate-comparison capability in which candidates are represented only by anonymous behavioral evidence (historical query embeddings, observed quality, normalized relative cost) with no model names or identity embeddings, and at inference the router stays frozen while adapting to new domains, modalities, candidate pools, and smaller context budgets through context alone, outperforming the strongest non-RouteFM baseline by 2.23 quality points on the pretraining-excluded MMR-Bench with eight observations per candidate.
The work introduces RouteFM, reframing large language model routing from environment-specific local fitting into a pretrain-once, route-anywhere foundation-model paradigm: episodic pretraining across heterogeneous routing environments learns a reusable, target-conditioned candidate-comparison capability in which candidates are represented only by anonymous behavioral evidence (historical query embeddings, observed quality, normalized relative cost) with no model names or identity embeddings, and at inference the router stays frozen while adapting to new domains, modalities, candidate pools, and smaller context budgets through context alone, outperforming the strongest non-RouteFM baseline by 2.23 quality points on the pretraining-excluded MMR-Bench with eight observations per candidate.