LiteLLM
Consider LiteLLM when prompts must stay in your own cloud or an air-gapped network, and you have engineers to run an MIT-licensed gateway with virtual keys and budgets.
An open-source AI gateway and Python SDK that calls 100+ LLM providers in the OpenAI format, self-hosted with virtual keys, budgets, and an admin UI.
- Pricing model
- The gateway and SDK are MIT-licensed and free to self-host; you pay providers directly with your own keys. An Enterprise licence adds SSO beyond five users, SCIM, audit logs, and support SLAs, with a 30-day free trial.
- Before choosing
- You deploy, update, and secure the gateway yourself, and SSO is free only for up to five users; price the Enterprise licence if you need it across the organisation.