https://github.com/agentgateway/agentgateway
Next Generation Agentic Proxy for AI Agents and MCP servers
https://github.com/agentgateway/agentgateway
agents ai ai-gateway api-gateway gateway-api kubernetes mcp mcp-gateway reverse-proxy rust service-mesh
Last synced: 10 days ago
JSON representation
Next Generation Agentic Proxy for AI Agents and MCP servers
- Host: GitHub
- URL: https://github.com/agentgateway/agentgateway
- Owner: agentgateway
- License: apache-2.0
- Created: 2025-03-18T20:55:22.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2026-07-23T17:33:46.000Z (14 days ago)
- Last Synced: 2026-07-23T18:12:14.020Z (14 days ago)
- Topics: agents, ai, ai-gateway, api-gateway, gateway-api, kubernetes, mcp, mcp-gateway, reverse-proxy, rust, service-mesh
- Language: Rust
- Homepage: https://agentgateway.dev
- Size: 28.3 MB
- Stars: 4,022
- Watchers: 32
- Forks: 668
- Open Issues: 293
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Codeowners: CODEOWNERS
- Security: SECURITY.md
Awesome Lists containing this project
- awesome-claude-mcp-servers - agentgateway - Data-Plane-Proxy für Agenten und MCP mit Sicherheits- und Governance-Kontrollen. `Rust` `remote` (Aggregatoren und Gateways / Claude API)
- awesome-codex-mcp-servers - agentgateway - Data-Plane-Proxy für Agenten und MCP mit Sicherheits- und Governance-Kontrollen. `Rust` `remote` (Aggregatoren und Gateways / Dieselbe Konfiguration, CLI und IDE)
- awesome-private-ai - agentgateway - Gateway for managing and orchestrating AI agents with support for local deployment. (Agents & Orchestration)
- awesome-x-ops - AgentGateway - generation agentic proxy for AI agents and MCP servers, providing secure access, routing, and policy management for agent tool integrations. (AI Infrastructure)
- awesome-claude-code - agentgateway/agentgateway - square&logo=github) | Agentic proxy and gateway for AI agents and MCP servers | (MCP Ecosystem / Core & Frameworks)
- awesome-ai-gateway - agentgateway - -s:agentgateway/agentgateway-->⭐ 3.7k<!--/s--> — CNCF proxy for agentic traffic: MCP governance and agent-to-agent (A2A) communication. (🤖 MCP & agent gateways / ✅ Why trust this list)
- awesome-mcp - agentgateway/agentgateway - Agentgateway is a high-performance, secure, and multi-tenant agent gateway designed for enterprise-grade deployments with robust MCP-focused features and dynamic configuration support. (MCP Servers / Agent Platforms)
- Awesome-LLMOps - agentgateway - commit/agentgateway/agentgateway?color=green) (Inference / AI Gateway)
- awesome-integration - agentgateway (⭐3.9k) - An open-source data plane for agentic AI connectivity, providing security, observability, and governance for agent-to-tool (MCP) and agent-to-agent (A2A) communication. (Projects / AI Gateway)
- awesome-mcp-gateways - agentgateway - Next Generation Agentic Proxy for AI Agents and MCP servers that provides drop-in security, observability, and governance for agent-to-agent and agent-to-tool communication. (Open-source MCP Gateways)
- awesome-openclaw-skills - agentgateway/agentgateway
- awesome-opensource-ai - Agent Gateway - Next-generation proxy and routing layer for AI agents and MCP servers, with Kubernetes-native transport, protocol interoperability, and service-mesh-style isolation for reliable agent infrastructure. Apache 2.0 licensed.  (4. Agentic AI & Multi-Agent Systems)
- awesome-agent-vault - agentgateway
- awesome-ai-tools - AgentGateway - brightgreen) — Open-source AI-native proxy/data plane (3.5k★). One high-performance Rust proxy governs all agent traffic: agent-to-LLM, agent-to-tool (via MCP), and agent-to-agent (via A2A), plus ordinary HTTP/gRPC. Donated to the Linux Foundation (Aug 2025). Contributors from AWS, Cisco, IBM, Microsoft, Red Hat. Handles auth, rate limiting, observability, and policy enforcement across all agent traffic. · `Apache-2.0` · Rust · 3.8k★ *GitHub API, 2026-07-09* (🧩 Agent Frameworks & SDKs / The three-vendor SDK race)
- awesome-harness-engineering - agentgateway - source agentic proxy that unifies LLM gateway, MCP gateway, and A2A gateway into a single control plane for managing multi-agent, multi-tool connectivity at scale. Provides drop-in security, observability, and governance for agent-to-LLM, agent-to-tool, and agent-to-agent communication — the missing infrastructure layer between agents and the services they touch.  (Design Primitives / Skills & MCP)
- awesome-agent-harness - GitHub - 3396-f4b400?style=flat-square)](https://github.com/agentgateway/agentgateway) | gateway, mcp, proxy | Agentic proxy gateway for AI agents and MCP server ecosystems. | (Catalog / Guardrails, Security & Governance)
- awesome-llm-gateways - agentgateway/agentgateway - 2.0 | Platform teams that need agentic AI traffic governance across LLM, MCP, and A2A flows. | OpenAI-compatible LLM routing, MCP and A2A gateway support, budget/spend controls, prompt enrichment, load balancing, failover, guardrails, auth/RBAC, OpenTelemetry, and Kubernetes options. | Broader agentic-proxy scope than a narrow model gateway; teams should validate LLM provider behavior and operational maturity against their own agent/tool traffic. | (Quick Comparison)
- awesome-mcp - Agentgateway - an open source proxy built on AI-native protocols (MCP & A2A) that provides drop-in security, observability, and governance for agent-to-LLM, agent-to-tool, and agent-to-agent communication across any framework and environment. (Security and Auth / Open Source)
- awesome-a2a - Agentgateway - Open-source, Linux Foundation AI gateway/proxy for LLM, MCP, and A2A traffic. Rewrites Agent Cards, proxies A2A tasks, and applies unified auth (JWT/mTLS/OAuth), RBAC, AI guardrails, rate limiting, and OpenTelemetry observability. Deploy standalone, via Docker, or on Kubernetes with Helm. Apache 2.0. (⚙️ Implementations & Libraries)
- awesome-infra-for-ai - agentgateway/agentgateway - Agentgateway is an open-source proxy offering unified connectivity and governance for AI agents and LLM providers, encompassing security, observability, and advanced traffic management features. (LLMOps / LLM Gateways & Proxies)
README
The first complete connectivity solution for Agentic AI.
---
**Agentgateway** is an open source proxy built on AI-native protocols ([MCP](https://modelcontextprotocol.io/introduction) & [A2A](https://developers.googleblog.com/en/a2a-a-new-era-of-agent-interoperability/)) that provides drop-in security, observability, and governance for agent-to-LLM, agent-to-tool, and agent-to-agent communication across any framework and environment.
## Intro to Agentgateway Video
## Key Features
- **LLM Gateway**
Route traffic to major LLM providers (OpenAI, Anthropic, Gemini, Bedrock, and more) through a unified OpenAI-compatible API with budget and spend controls, prompt enrichment, load balancing, and failover.
- **MCP Gateway**
Connect LLMs to tools and external data sources via MCP with tool federation, stdio/HTTP/SSE/Streamable HTTP transports, OpenAPI integration, and OAuth authentication.
- **A2A Gateway**
Enable secure agent-to-agent communication using A2A, with capability discovery, modality negotiation, and task collaboration.
- **Inference Routing**
Intelligent routing to self-hosted models using Kubernetes Inference Gateway extensions, with decisions based on GPU utilization, KV cache, LoRA adapters, and queue depth.
- **Guardrails**
Multi-layered content filtering with regex, OpenAI moderation, AWS Bedrock Guardrails, Google Model Armor, and custom webhooks.
- **Security & Observability**
Auth (JWT, API keys, OAuth), fine-grained RBAC with CEL policy engine, rate limiting, TLS, and OpenTelemetry metrics/logs/tracing.
## Getting Started
- [Standalone Quickstart](https://agentgateway.dev/docs/standalone/latest/quickstart) — Get started with agentgateway in minutes.
- [Kubernetes Quickstart](https://agentgateway.dev/docs/kubernetes/latest/quickstart) — Deploy on Kubernetes using the built-in controller and Gateway API.
## Documentation
Depending on your deployment environment, check out the following docs:
- [agentgateway.dev/docs](https://agentgateway.dev/docs/standalone/latest): For deployments without the full Kubernetes controller, driven by flat yaml config.
- [agentgateway.dev/docs/kubernetes/latest](https://agentgateway.dev/docs/kubernetes/latest): For Kubernetes-based deployments using the built-in Kubernetes controller and Gateway API support.
Agentgateway has a built-in UI for you to explore agentgateway connecting agent-to-agent or agent-to-tool:
## Sponsors
Thank you to our sponsors for helping to fund the development of agentgateway!
## Contributing
For instructions on how to contribute to the agentgateway project, see the [CONTRIBUTION.md](CONTRIBUTION.md) file.
## Community Meetings
To join a community meeting, add the [agentgateway calendar](https://calendar.google.com/calendar/u/0?cid=Y18zZTAzNGE0OTFiMGUyYzU2OWI1Y2ZlOWNmOWM4NjYyZTljNTNjYzVlOTdmMjdkY2I5ZTZmNmM5ZDZhYzRkM2ZmQGdyb3VwLmNhbGVuZGFyLmdvb2dsZS5jb20) to your Google account. Then, you can find event details on the calendar.
Recordings of the community meetings will be published on our [google drive](https://drive.google.com/drive/folders/138716fESpxLkbd_KkGrUHa6TD7OA2tHs?usp=sharing).
## Roadmap
`agentgateway` is currently in active development. If you'd like a feature that's missing, open an issue in our [GitHub repo](https://github.com/agentgateway/agentgateway/issues).
## Contributors
Thanks to all contributors who are helping to make agentgateway better.
---
