https://github.com/BerriAI/litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
https://github.com/BerriAI/litellm

ai-gateway anthropic azure-openai bedrock gateway langchain llm llm-gateway llmops openai openai-proxy vertex-ai

Last synced: 12 months ago
JSON representation

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

• Host: GitHub
• URL: https://github.com/BerriAI/litellm
• Owner: BerriAI
• License: other
• Created: 2023-07-27T00:09:52.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2025-03-18T01:36:04.000Z (12 months ago)
• Last Synced: 2025-03-18T01:45:34.347Z (12 months ago)
• Topics: ai-gateway, anthropic, azure-openai, bedrock, gateway, langchain, llm, llm-gateway, llmops, openai, openai-proxy, vertex-ai
• Language: Python
• Homepage: https://docs.litellm.ai/docs/
• Size: 353 MB
• Stars: 19,229
• Watchers: 106
• Forks: 2,382
• Open Issues: 1,437
• Metadata Files:
  • Readme: README.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE
  • Security: security.md

Awesome Lists containing this project

• awesome-prompts - LiteLLM
• awesome-mlops - LiteLLM
• awesome-llm-services - LiteLLM
• awesome-llm-json - LiteLLM
• StarryDivineSky - BerriAI/litellm
• awesome-mistral - LiteLLM
• awesome-ml-python-packages - litellm
• awesome-ai - litellm - Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq] (Uncategorized / Uncategorized)
• awesome-LLM-resources - LiteLLM
• awesome - BerriAI/litellm - Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. \[Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM] (Python)
• awesome-rainmana - BerriAI/litellm - Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropi (Python)
• awesome_ai_agents - LiteLLM - LiteLLM has added support for the OpenAI Assistants API, enabling seamless integration of stateful operations and automatic RAG pipelines into existing chatbots [github](https://github.com/BerriAI/litellm) (Learning / Repositories)
• awesome-safety-critical-ai - `BerriAI/litellm`
• awesome-generative-ai-data-scientist - LiteLLM
• AiTreasureBox - BerriAI/litellm - 11-03_30593_4](https://img.shields.io/github/stars/BerriAI/litellm.svg)|Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)| (Repos)
• awesome-local-ai - LiteLLM - Call all LLM APIs using the OpenAI format. (Developer tools)
• awesome-data-analysis - LiteLLM - Unified interface to call all LLM APIs (OpenAI, Anthropic, Cohere, etc.) with consistent output formatting. (🚀 MLOps / Tools)
• awesome-ai-agents - BerriAI/litellm - LiteLLM is a Python SDK and proxy server that provides a unified OpenAI-compatible interface to call over 100 large language model APIs from multiple providers, featuring consistent output, retry logic, budget controls, and extensive observability integrations. (Agent Integration & Deployment Tools / Stateful Serverless Frameworks)
• awesome-production-machine-learning - LiteLLM - LiteLLM is a Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq. (Deployment and Serving)
• awesome-production-llm - LiteLLM
• Awesome-RAG - litellm - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]. | [](https://github.com/BerriAI/litellm/stargazers) | (Model Serving / UI/Interface Tutorials)
• my-awesome - BerriAI/litellm - gateway,anthropic,azure-openai,bedrock,gateway,langchain,litellm,llm,llm-gateway,llmops,mcp-gateway,openai,openai-proxy,vertex-ai pushed_at:2026-02 star:36.0k fork:5.8k Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM] (Python)
• Awesome-LLMOps - LiteLLM - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq].    (Inference / LLM Router)
• awesome-repositories - BerriAI/litellm - Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropi (Python)
• awesome - BerriAI/litellm - Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM] (<a name="Python"></a>Python)
• awesome-ai-eval - **LiteLLM** - Unified API for 100+ LLM providers with cost tracking, fallbacks, and load balancing. (Platforms / Open Source Platforms)
• awesome-cloud-native - litellm - Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]. (API Gateways & Proxies)
• awesome-llm - LiteLLM - **最流行代理**。用统一的 OpenAI 格式调用 100+ 种 LLM API，支持负载均衡和成本追踪。 (LLM 部署与推理 (Deployment & Inference) / 推理网关 (Inference Gateways))
• jimsghstars - BerriAI/litellm - Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq] (Python)