Skip to main content
Search

# LLM provider routing

1 related articles

Subscribe to updates
  1. OpenRouter Blog

    OpenRouter's routing now drives Hugging Face inference: 160 models pick price, speed and reliability per request

    Chat-model inference on Hugging Face now runs through OpenRouter's provider routing, which picks a provider for each request from live price, speed and reliability and fails over automatically. Previously developers had to choose among providers themselves. OpenRouter reports that a live experiment when it rebuilt this routing in October measured 46% fewer requests hitting a capacity error, 16.9% faster time to first token and 16.3% higher throughput, at 6.0% higher cost per request. 160 models from 38 labs are available this way today.

You’re all caught up