https://github.com/BerriAI/litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
https://github.com/BerriAI/litellm
ai-gateway anthropic azure-openai bedrock gateway langchain llm llm-gateway llmops openai openai-proxy vertex-ai
Last synced: 27 days ago
JSON representation
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
- Host: GitHub
- URL: https://github.com/BerriAI/litellm
- Owner: BerriAI
- License: other
- Created: 2023-07-27T00:09:52.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-03-18T01:36:04.000Z (about 1 month ago)
- Last Synced: 2025-03-18T01:45:34.347Z (about 1 month ago)
- Topics: ai-gateway, anthropic, azure-openai, bedrock, gateway, langchain, llm, llm-gateway, llmops, openai, openai-proxy, vertex-ai
- Language: Python
- Homepage: https://docs.litellm.ai/docs/
- Size: 353 MB
- Stars: 19,229
- Watchers: 106
- Forks: 2,382
- Open Issues: 1,437
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE
- Security: security.md
Awesome Lists containing this project
- awesome-local-ai - LiteLLM - Call all LLM APIs using the OpenAI format. (Developer tools)
- awesome-prompts - LiteLLM
- awesome-llm-json - LiteLLM
- StarryDivineSky - BerriAI/litellm
- awesome - BerriAI/litellm - Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - \[Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq] (Python)
- awesome-repositories - BerriAI/litellm - Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq] (Python)
- jimsghstars - BerriAI/litellm - Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq] (Python)
- awesome-LLM-resourses - LiteLLM
- awesome_ai_agents - LiteLLM - LiteLLM has added support for the OpenAI Assistants API, enabling seamless integration of stateful operations and automatic RAG pipelines into existing chatbots [github](https://github.com/BerriAI/litellm) (Learning / Repositories)
- awesome_ai_agents - LiteLLM - LiteLLM has added support for the OpenAI Assistants API, enabling seamless integration of stateful operations and automatic RAG pipelines into existing chatbots [github](https://github.com/BerriAI/litellm) (Learning / Repositories)
- Awesome-LLMOps - LiteLLM - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq].    (Gateway / LLM Router)
- Awesome-LLMOps - LiteLLM - Azure, OpenAI, Cohere, Anthropic, Replicate. Manages input/output translation | | (LLMOps)
- awesome-rainmana - BerriAI/litellm - Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq] (Python)
- awesome-safety-critical-ai - `BerriAI/litellm`
- AiTreasureBox - BerriAI/litellm - 04-15_20761_4](https://img.shields.io/github/stars/BerriAI/litellm.svg)|Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)| (Repos)
- awesome-generative-ai-data-scientist - LiteLLM