An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with openai-proxy

A curated list of projects in awesome lists tagged with openai-proxy .

https://github.com/berriai/litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

ai-gateway anthropic azure-openai bedrock gateway langchain litellm llm llm-gateway llmops mcp-gateway openai openai-proxy vertex-ai

Last synced: 08 Oct 2025

https://github.com/BerriAI/litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

ai-gateway anthropic azure-openai bedrock gateway langchain llm llm-gateway llmops openai openai-proxy vertex-ai

Last synced: 23 Mar 2025

https://github.com/kenyony/openai-forward

🚀 大语言模型高效转发服务 · An efficient forwarding service designed for LLMs. · OpenAI API Reverse Proxy

llm openai openai-api openai-proxy proxy python rate-limit

Last synced: 11 Apr 2025

https://github.com/KenyonY/openai-forward

🚀 大语言模型高效转发服务 · An efficient forwarding service designed for LLMs. · OpenAI API Reverse Proxy

llm openai openai-api openai-proxy proxy python rate-limit

Last synced: 09 Apr 2025

https://github.com/gabrielkoo/bedrock-access-gateway-function-url

OpenAI-Compatible RESTful APIs for Amazon Bedrock, modified from the original "bedrock-access-gateway" project for not using ALB, so that one could deploy and use it under a pay as you go model WITH NO FIXED COSTS.

bedrock genai openai openai-api openai-proxy pay-as-you-go proxy sam serverless

Last synced: 11 Jun 2025

https://github.com/lianjiatech/bella-openapi

Bella OpenAPI是一个提供了丰富的AI调用能力的API网关,可类比openrouter,与之不同的是除了提供聊天补全(chat-completion)能力外,还提供了文本向量化(text-embedding)、语音识别(ASR)、语音合成(TTS)、文生图、图生图等多种AI能力,同时集成了计费、限流和资源管理功能。且集成的所有能力都经过了大规模生产环境的验证。

ai-gateway azure-openai bedrock deepseek llm llm-gateway llmops openai openai-proxy volcengine

Last synced: 29 Dec 2025

https://github.com/tanantor/langgate

Lightweight AI inference gateway - local model registry & parameter transformer (Python SDK) - with optional Envoy proxy processor and FastAPI registry server deployment options.

ai ai-gateway ai-proxy aiops anthropic azure-openai bedrock envoy fastapi gateway langchain langchain-python llm llm-gateway llmops mlops openai openai-proxy registry vertex-ai

Last synced: 26 Aug 2025

https://github.com/knnlabs/conduit

A unified API gateway for multiple LLM providers with OpenAI-compatible endpoints

gateway llm llm-gateway openai-proxy

Last synced: 19 Jun 2025

https://github.com/lightning-ai/litai

The easiest way to use any AI model. Build chatbots, agents, and AI apps that just work - with auto-retries, fallback, and unified billing built in.

agents ai ai-gateway api chatbot llm llm-gateway llm-inference openai openai-proxy

Last synced: 30 Jul 2025

https://github.com/nazdridoy/llm-proxy

A robust, transparent REST API proxy service for LLM APIs with profile-based configuration and comprehensive logging.

ai-gateway azure-openai gateway gemini-openai llm llm-gateway openai openai-proxy

Last synced: 15 Jul 2025

https://github.com/tctien342/chatgpt-proxy

This project serves as a proxy for the OpenAI API. Using bun as runtime.

chatgpt-api openai openai-proxy

Last synced: 04 Apr 2025

https://github.com/yinheli/openai-relay

A Simple OpenAI API relay service built with Bun runtime, supporting various OpenAI-compatible backend services.

openai-proxy openai-relay

Last synced: 28 Mar 2025

https://github.com/douglarek/cf-openai-proxy

An openai proxy powered by cloudflare python workers

cloudflare-python cloudflare-workers openai-proxy

Last synced: 03 Apr 2025

https://github.com/alirezaazadbakht/minimal-fastapi-openai-proxy

A minimal FastAPI proxy for OpenAI’s Chat Completions and Embeddings APIs. Supports wrapper API keys that map to real OpenAI API keys, enabling multi-tenant usage, simple key management, and full compatibility with the official OpenAI Python SDK.

chatbot chatgpt fastapi openai openai-api openai-proxy

Last synced: 31 Aug 2025