litellm

by BerriAI · AI

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tra

★ New0 ratings58,169 stars● Active

AIAI ApplicationPythonTypeScript

Open project ↗↓ Download v1.100.0 GitHub⚑ Report

litellm preview

About this project

🚅 LiteLLM LiteLLM AI Gateway Open Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready. Call any LLM in OpenAI format. LiteLLM Proxy Server (AI Gateway) Hosted Proxy Enterprise Tier Website What is LiteLLM LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers — OpenAI, Anthropic, Gemini, Bedrock, Azure, and more — using the OpenAI format. Use it as a Python SDK for direct library integration, or deploy the AI Gateway (Proxy Server) as a centralized service for your team or organization. Jump to LiteLLM Proxy (LLM Gateway) Docs Jump to Supported…

Technologies

TypeScriptPythonHTMLRustanthropicGoai-gatewayazure-openai

Project health

● Actively maintained

Last update2 days ago

Contributors376

Latest releasev1.100.0

Open issues & PRs4,927

LicenseOther

On GitHubsince 2023

GitHub

58,169

stars

11,218

forks

376

contributors

4,927

open issues & PRs

Python

language

2 days ago

last commit

View on GitHub ↗All releases ↗

Reviews

—out of 5 · 0 ratings

★★★★★

0%

★★★★

0%

★★★

0%

★★

0%

★

0%

Sign in to write a review

No reviews yet

Be the first to review litellm.

Built by

BerriAI

Imported from GitHub · not yet claimed on GitPalace

View developer page Sign in with GitHub to claim

Maintain BerriAI/litellm? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like

The AI that really does things. Any OS. Any Platform. The lobster way. 🦞

★ New389K stars

An agentic skills framework & software development methodology that works.

★ New282.4K stars

The agent that grows with you

★ New242.5K stars

by NousResearch

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host

★ New203.6K stars