https://github.com/Portkey-AI/gateway
A Blazing Fast AI Gateway. Route to 200+ LLMs with 1 fast & friendly API.
https://github.com/Portkey-AI/gateway
ai-gateway gateway generative-ai langchain llama-index llmops llms openai prompt-engineering router
Last synced: about 1 year ago
JSON representation
A Blazing Fast AI Gateway. Route to 200+ LLMs with 1 fast & friendly API.
- Host: GitHub
- URL: https://github.com/Portkey-AI/gateway
- Owner: Portkey-AI
- Created: 2023-08-23T11:52:47.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2024-06-12T12:29:48.000Z (about 2 years ago)
- Last Synced: 2024-06-12T16:10:18.200Z (about 2 years ago)
- Topics: ai-gateway, gateway, generative-ai, langchain, llama-index, llmops, llms, openai, prompt-engineering, router
- Language: Jupyter Notebook
- Homepage: https://portkey.ai/features/ai-gateway
- Size: 53.2 MB
- Stars: 4,948
- Watchers: 35
- Forks: 338
- Open Issues: 66
-
Metadata Files:
- Readme: README.md
- Contributing: .github/CONTRIBUTING.cn.md
- Code of conduct: .github/CODE_OF_CONDUCT.cn.md
- Security: .github/SECURITY.md
- Support: .github/SUPPORT.md
Awesome Lists containing this project
- AiTreasureBox - Portkey-AI/gateway - 11-03_9784_0](https://img.shields.io/github/stars/Portkey-AI/gateway.svg)|A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.| (Repos)
- awesome-ai-api-projects - gateway - commit/Portkey-AI/gateway?label=%20) | (AI Agent / Framework)
- StarryDivineSky - Portkey-AI/gateway
- Awesome-LLM - AI Gateway - ready with support for caching, fallbacks, retries, timeouts, loadbalancing, and can be edge-deployed for minimum latency. (LLM Deployment)
- Awesome-RAG-Production - Portkey - host / Cloud | 200+ providers | Built-in | Dashboard | Enterprise gateway with observability | (LLM Gateways & Routing / Tools)
- awesome-llm-cost - Portkey - AI gateway with semantic caching, guardrails, programmable routing, and observability. Self hostable or managed. (Routing and Model Selection / Gateways and proxies)
- awesome-agents - Portkey - AI gateway for routing, monitoring, and managing requests across 200+ LLM providers. (Monitoring and Observability)
- awesome-langchain-zh - Gateway - AI/gateway?style=social): 一个强大的ai网关. (其他LLM框架 / 文章)
- Awesome-LLMOps - AI Gateway - ai/gateway.svg?style=flat&color=green)   (Inference / LLM Router)
- awesome-langchain - Gateway - AI/gateway?style=social) (Other LLM Frameworks / Videos Playlists)
- awesome-ccamel - Portkey-AI/gateway - A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. (TypeScript)
- jimsghstars - Portkey-AI/gateway - A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. (TypeScript)
- awesome-opensource-ai - Portkey Gateway - Blazing fast AI Gateway to route 200+ LLMs with unified API. Integrated guardrails, load balancing, fallbacks, and cost tracking. MIT licensed.  (8. MLOps / LLMOps & Production)
- awesome-llm-tools - Portkey
- awesome - Portkey-AI/gateway - A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. (TypeScript)
- awesome-integration - Portkey AI Gateway (⭐12k) - A fast AI gateway that routes to 250+ LLMs with guardrails, caching, retries, and load balancing via a single API. (Projects / AI Gateway)
- awesome-open-source-ai-tools - Portkey-AI/gateway - A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. (Coding & Development)
- awesome-github-projects - gateway - A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. ⭐12,108 `TypeScript` 🔥 (🤖 AI & Machine Learning)
- awesome-llm-tools - Portkey Gateway - source models with caching, fallbacks, retries, load-balancing, and edge deployment | Any | Any | (8. Inference Engines / Server / Production)
- awesome - Portkey-AI/gateway - A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. (TypeScript)
- awesome-agent-cortex - Portkey - AI gateway with observability, caching, and fallback routing. (Agent Observability and Testing / Benchmark Reality Check (real-world tool use))
- awesome-agent-collaborate-tools - Portkey AI Gateway - Open-source AI gateway with fallbacks, retries, load balancing, and request routing across 200+ LLMs. Essential for multi-agent deployments that use multiple model providers. (Developer Tools & SDKs)
- awesome-llm-gateways - Portkey-AI/gateway - hosting depth should be checked for each feature. | (Quick Comparison)