Skip to main content
Search

# Private Inference

1 related articles

Subscribe to updates
  1. Vercel News

    Vercel's AI Gateway adds Private Inference: self-hosted and fine-tuned models now share one key, SDK and log

    Vercel's AI Gateway has added Private Inference, which connects enterprise self-hosted, fine-tuned or prerelease models as private providers. Such models previously needed separate keys, client code and logs; they now share the same authentication, SDKs, APIs and observability as catalog models, and switching only changes the model ID to private/<slug> while the gateway translates each request to the endpoint's format. Private models are visible only to their team, stay out of the public catalog, store credentials encrypted, and can enable Zero Data Retention per provider.

You’re all caught up