Projects in Awesome Lists tagged with openai-proxy

https://github.com/kong/kong

🦍 The Cloud-Native API Gateway and AI Gateway.

ai ai-gateway api-gateway api-management apis artificial-intelligence cloud-native devops kubernetes kubernetes-ingress kubernetes-ingress-controller llm-gateway llm-ops luajit microservice microservices nginx openai-proxy reverse-proxy serverless

Last synced: 09 Sep 2025

https://github.com/berriai/litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

ai-gateway anthropic azure-openai bedrock gateway langchain litellm llm llm-gateway llmops mcp-gateway openai openai-proxy vertex-ai

Last synced: 24 May 2026

https://github.com/BerriAI/litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

ai-gateway anthropic azure-openai bedrock gateway langchain llm llm-gateway llmops openai openai-proxy vertex-ai

Last synced: 23 Mar 2025

https://github.com/diegosouzapw/omniroute

Never stop coding. Free AI gateway: one endpoint, 160+ providers (50+ free), connect Claude Code, Codex, Cursor, Cline & Copilot to FREE Claude/GPT/Gemini. RTK+Caveman stacked compression saves 15-95% tokens, smart auto-fallback, MCP/A2A, multimodal APIs, Desktop/PWA.

a2a ai-agents ai-gateway anthropic claude claude-code cline codex copilot cursor deepseek free-ai gemini gemini-cli llm-gateway mcp openai openai-proxy qwen token-saver

Last synced: 27 May 2026

https://github.com/gaboolic/vercel-reverse-fast

vercel加速OpenAI/ChatGPT

github-proxy google-proxy openai-proxy reverse-proxy vercel vercel-proxy

Last synced: 22 Jul 2025

https://github.com/kenyony/openai-forward

🚀 大语言模型高效转发服务 · An efficient forwarding service designed for LLMs. · OpenAI API Reverse Proxy

llm openai openai-api openai-proxy proxy python rate-limit

Last synced: 11 Apr 2025

https://github.com/gaboolic/cloudflare-reverse-fast

cloudflare加速openai等接口

chatgpt-proxy cloudflare cloudflare-proxy cloudflare-reverse-proxy github-proxy google-proxy openai-proxy reverse-proxy

Last synced: 21 Jul 2025

https://github.com/KenyonY/openai-forward

🚀 大语言模型高效转发服务 · An efficient forwarding service designed for LLMs. · OpenAI API Reverse Proxy

llm openai openai-api openai-proxy proxy python rate-limit

Last synced: 09 Apr 2025

https://github.com/lianjiatech/bella-openapi

Bella OpenAPI是一个提供了丰富的AI调用能力的API网关，可类比openrouter，与之不同的是除了提供聊天补全(chat-completion)能力外，还提供了文本向量化(text-embedding)、语音识别(ASR)、语音合成(TTS)、文生图、图生图等多种AI能力，同时集成了计费、限流和资源管理功能。且集成的所有能力都经过了大规模生产环境的验证。

ai-gateway azure-openai bedrock deepseek llm llm-gateway llmops openai openai-proxy volcengine

Last synced: 01 Apr 2026

https://github.com/nyroway/nyro

Self-hosted AI Gateway — connect Claude Code, Codex, Gemini CLI and any SDK to any model provider with protocol translation.

ai ai-gateway ai-proxy claude-proxy gateway gemini-proxy llm-gateway llm-router mcp-gateway openai-proxy

Last synced: 19 May 2026

https://github.com/gabrielkoo/bedrock-access-gateway-function-url

OpenAI-Compatible RESTful APIs for Amazon Bedrock, modified from the original "bedrock-access-gateway" project for not using ALB, so that one could deploy and use it under a pay as you go model WITH NO FIXED COSTS.

bedrock genai openai openai-api openai-proxy pay-as-you-go proxy sam serverless

Last synced: 11 Jun 2025

https://github.com/peva3/smarterrouter

SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.

ai-cache ai-gateway docker fastapi gpu-monitoring llm llm-proxy llm-router local-llm model-serving ollama ollama-api openai-proxy self-hosted self-hosted-ai semantic-cache

Last synced: 27 Feb 2026

https://github.com/alfianlosari/firebase-openai-proxy

OpenAI Proxy Server using Firebase Functions with sample iOS App

api-key chatgpt chatgpt-ios chatgpt-proxy firebase-functions firebase-functions-proxy ios-api-key ios-app nodejs openai-proxy proxy swift

Last synced: 22 Sep 2025

https://github.com/langfuse/oss-llmops-stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance evaluations.

ai-gateway gateway llm llm-evaluation llm-gateway llm-observability llmops monitoring open-source openai-proxy prompt-management self-hosted ycombinator

Last synced: 01 Apr 2026

https://github.com/tanantor/langgate

Lightweight AI inference gateway - local model registry & parameter transformer (Python SDK) - with optional Envoy proxy processor and FastAPI registry server deployment options.

ai ai-gateway ai-proxy aiops anthropic azure-openai bedrock envoy fastapi gateway langchain langchain-python llm llm-gateway llmops mlops openai openai-proxy registry vertex-ai

Last synced: 26 Aug 2025

https://github.com/riipandi/radium

[WIP] Radium is an open-source LLM proxy gateway built for resource efficiency and high performance.

ai ai-gateway antrophic gateway llm llm-gateway llm-proxy llmops mcp-gateway openai openai-compatible openai-proxy

Last synced: 15 May 2026

https://github.com/lightning-ai/litai

The easiest way to use any AI model. Build chatbots, agents, and AI apps that just work - with auto-retries, fallback, and unified billing built in.

agents ai ai-gateway api chatbot llm llm-gateway llm-inference openai openai-proxy

Last synced: 30 Jul 2025

https://github.com/knnlabs/conduit

A unified API gateway for multiple LLM providers with OpenAI-compatible endpoints

gateway llm llm-gateway openai-proxy

Last synced: 19 Jun 2025

https://github.com/ivan-yuldashev/promtix

Promtix is a self-hosted AI Gateway and Prompt Management System designed for privacy-conscious teams. It sits between your product code and LLM providers (OpenAI, Anthropic, etc.).

ai-gateway anthropic-proxy developer-tools gemini-proxy llm llmops openai-proxy prompt-engineering self-hosted

Last synced: 30 Apr 2026

https://github.com/lxfu1/ai-router

Intelligent Relay Hub for AI Models

ai-gateway llm-gateway openai-proxy

Last synced: 30 May 2026

https://github.com/alirezaazadbakht/minimal-fastapi-openai-proxy

A minimal FastAPI proxy for OpenAI’s Chat Completions and Embeddings APIs. Supports wrapper API keys that map to real OpenAI API keys, enabling multi-tenant usage, simple key management, and full compatibility with the official OpenAI Python SDK.

chatbot chatgpt fastapi openai openai-api openai-proxy