Skip to main content
Search

# Probabilistic Semantic State

1 related articles

Subscribe to updates
  1. arXiv

    SeLMRoute turns query requirements into a probabilistic state via 16 interpretable semantic probes, reaching 72.08% average accuracy on LLMRouterBench

    SeLMRoute splits LLM routing into three stages: a decision model first answers 16 interpretable semantic questions about each query and keeps the probability distributions as a 40-dimensional semantic state, a lightweight supervised regressor then predicts each candidate model's performance, and deployment objectives are applied last; on LLMRouterBench (15 datasets, 20 candidate models, 11,481 queries) it reaches 72.08%±0.45 average accuracy and 72.64% under grouped five-fold out-of-fold evaluation, versus 69.23% for the strongest fixed candidate, and in a 13-model performance-cost setting it improves performance in all five grouped splits with a mean PerfGain of 2.66%.

You’re all caught up