Skip to main content
7BBusyBoss

litellm

by BerriAI

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

⭐ 51,145 stars🍴 9,072 forksPythonUpdated 6/22/2026proxymulti-providerai-gatewayanthropicazure-openaibedrock
Start hereRead the setup guide →Install steps and usage, straight from the docs.Source codeDownload ZIPLatest commit on default branch.SourceView on GitHubgithub.com/BerriAI/litellm
Project site: docs.litellm.ai/docs/

About litellm

litellm is a Python open-source devops & mlops project by BerriAI. Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM] With 51,145 GitHub stars and 9,072forks, it's one of the DevOps & MLOps tools worth knowing. You can download the source, browse it on GitHub, or read the full setup guide in the README below.

From the project README

🚅 LiteLLM

LiteLLM AI Gateway

Open Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready. Call any LLM in OpenAI format.

Deploy to Render Deploy on Railway Deploy on AWS Deploy on GCP

This is an excerpt from the project's own README, quoted here for reference. Read the full README on GitHub →

litellm — FAQ

What is litellm?

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Is litellm free to use?

Yes. litellm is open-source and free. You can browse the source on GitHub or download it here at no cost — no signup required.

How do I install and run litellm?

Download the latest source as a ZIP from GitHub (or clone the litellm_internal_staging branch), then follow the setup steps in the README below.

What language is litellm written in?

litellm is primarily written in Python.

How popular is litellm?

litellm has 51,145 stars and 9,072 forks on GitHub, and was last updated 6/22/2026 — a useful signal of how actively it's maintained and trusted by developers.