https://github.com/envoyproxy/ai-gateway
Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.
https://github.com/envoyproxy/ai-gateway
ai ai-gateway api-gateway cncf kubernetes llm
Last synced: 3 days ago
JSON representation
Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.
- Host: GitHub
- URL: https://github.com/envoyproxy/ai-gateway
- Owner: envoyproxy
- License: apache-2.0
- Created: 2024-10-21T02:59:59.000Z (6 months ago)
- Default Branch: main
- Last Pushed: 2025-04-07T12:56:25.000Z (8 days ago)
- Last Synced: 2025-04-07T13:39:45.926Z (8 days ago)
- Topics: ai, ai-gateway, api-gateway, cncf, kubernetes, llm
- Language: Go
- Homepage: https://aigateway.envoyproxy.io/
- Size: 3.39 MB
- Stars: 204
- Watchers: 13
- Forks: 41
- Open Issues: 33
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Codeowners: CODEOWNERS
Awesome Lists containing this project
- Awesome-LLMOps - Envoy AI Gateway - gateway.svg?style=flat&color=green)   (Gateway / API Gateway)
README
# Envoy AI Gateway
Envoy AI Gateway is an open source project for using [Envoy Gateway](https://github.com/envoyproxy/gateway) to handle request traffic from application clients to Generative AI services.
## Contact
* Slack: Join the [Envoy Slack workspace][] if you're not already a member. Otherwise, use the
[Envoy AI Gateway channel][] to start collaborating with the community.
## Get Involved
We adhere to the [CNCF Code of conduct][Code of conduct]
The Envoy AI Gateway team and community members meet every Thursday.
Please register for the meeting, add agenda points, and get involved. The
meeting details are available in the [public document][meeting].
To contribute to the project via pull requests, please read the [CONTRIBUTING.md](CONTRIBUTING.md) file
which includes information on how to build and test the project.
## Background
The proposal of using Envoy Gateway as a [Cloud Native LLM Gateway][Cloud Native LLM Gateway] inspired the initiation of this project.
[meeting]: https://docs.google.com/document/d/10e1sfsF-3G3Du5nBHGmLjXw5GVMqqCvFDqp_O65B0_w/edit?tab=t.0
[Envoy Slack workspace]: https://communityinviter.com/apps/envoyproxy/envoy
[Envoy AI Gateway channel]: https://envoyproxy.slack.com/archives/C07Q4N24VAA
[Code of conduct]: https://github.com/cncf/foundation/blob/main/code-of-conduct.md
[Cloud Native LLM Gateway]: https://docs.google.com/document/d/1FQN_hGhTNeoTgV5Jj16ialzaSiAxC0ozxH1D9ngCVew/edit?tab=t.0#heading=h.uuu99yemq4eo