{"id":13492126,"url":"https://github.com/aeraki-mesh/aeraki","last_synced_at":"2026-02-10T00:08:48.666Z","repository":{"id":36974803,"uuid":"310173647","full_name":"aeraki-mesh/aeraki","owner":"aeraki-mesh","description":"Manage any layer-7 protocols in a Service Mesh.","archived":false,"fork":false,"pushed_at":"2024-04-19T12:31:42.000Z","size":5624,"stargazers_count":742,"open_issues_count":19,"forks_count":140,"subscribers_count":22,"default_branch":"master","last_synced_at":"2024-10-29T15:44:41.994Z","etag":null,"topics":["brpc","dubbo","envoy","envoyproxy","istio","redis","service-mesh","servicemesh","thrift","trpc"],"latest_commit_sha":null,"homepage":"https://www.aeraki.net","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/aeraki-mesh.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null,"governance":"GOVERNANCE.md","roadmap":null,"authors":null,"dei":null}},"created_at":"2020-11-05T02:50:27.000Z","updated_at":"2024-10-22T16:02:49.000Z","dependencies_parsed_at":"2024-04-02T10:42:53.531Z","dependency_job_id":"45cabedf-0938-4439-b4a3-68bc2ff5e129","html_url":"https://github.com/aeraki-mesh/aeraki","commit_stats":{"total_commits":429,"total_committers":35,"mean_commits":"12.257142857142858","dds":0.5827505827505828,"last_synced_commit":"1011e10cf8da1bc0a8cdd5ac1124a984095be753"},"previous_names":["aeraki-framework/aeraki"],"tags_count":19,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aeraki-mesh%2Faeraki","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aeraki-mesh%2Faeraki/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aeraki-mesh%2Faeraki/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aeraki-mesh%2Faeraki/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/aeraki-mesh","download_url":"https://codeload.github.com/aeraki-mesh/aeraki/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":222369772,"owners_count":16973285,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["brpc","dubbo","envoy","envoyproxy","istio","redis","service-mesh","servicemesh","thrift","trpc"],"created_at":"2024-07-31T19:01:03.333Z","updated_at":"2026-02-10T00:08:48.657Z","avatar_url":"https://github.com/aeraki-mesh.png","language":"Go","funding_links":[],"categories":["Go","redis"],"sub_categories":[],"readme":"\u003c!--\n# Copyright Aeraki Authors\n#\n# Licensed under the Apache License, Version 2.0 (the \"License\");\n# you may not use this file except in compliance with the License.\n\n[![FOSSA Status](https://app.fossa.com/api/projects/git%2Bgithub.com%2Faeraki-mesh%2Faeraki.svg?type=large)](https://app.fossa.com/projects/git%2Bgithub.com%2Faeraki-mesh%2Faeraki?ref=badge_large)\n\n# You may obtain a copy of the License at\n#\n#     http://www.apache.org/licenses/LICENSE-2.0\n#\n# Unless required by applicable law or agreed to in writing, software\n# distributed under the License is distributed on an \"AS IS\" BASIS,\n# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n# See the License for the specific language governing permissions and\n# limitations under the License.\n--\u003e\n\n# Aeraki （[中文](./README.zh-CN.md)）\n\n[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://github.com/aeraki-mesh/aeraki/blob/master/LICENSE)\n[![Go Report Card](https://goreportcard.com/badge/github.com/aeraki-mesh/aeraki)](https://goreportcard.com/report/github.com/aeraki-mesh/aeraki)\n[![CI Tests](https://github.com/aeraki-mesh/aeraki/workflows/ci/badge.svg?branch=master)](https://github.com/aeraki-mesh/aeraki/actions?query=branch%3Amaster+event%3Apush+workflow%3A%22ci%22)\n[![E2E Tests](https://github.com/aeraki-mesh/aeraki/workflows/e2e-metaprotocol/badge.svg?branch=master)](https://github.com/aeraki-mesh/aeraki/actions?query=branch%3Amaster+event%3Apush+workflow%3A%22e2e-metaprotocol%22)\n[![E2E Tests](https://github.com/aeraki-mesh/aeraki/workflows/e2e-dubbo/badge.svg?branch=master)](https://github.com/aeraki-mesh/aeraki/actions?query=branch%3Amaster+event%3Apush+workflow%3A%22e2e-dubbo%22)\n[![E2E Tests](https://github.com/aeraki-mesh/aeraki/workflows/e2e-thrift/badge.svg?branch=master)](https://github.com/aeraki-mesh/aeraki/actions?query=branch%3Amaster+event%3Apush+workflow%3A%22e2e-thrift%22)\n[![E2E Tests](https://github.com/aeraki-mesh/aeraki/workflows/e2e-kafka-zookeeper/badge.svg?branch=master)](https://github.com/aeraki-mesh/aeraki/actions?query=branch%3Amaster+event%3Apush+workflow%3A%22e2e-kafka-zookeeper%22)\n[![E2E Tests](https://github.com/aeraki-mesh/aeraki/workflows/e2e-redis/badge.svg?branch=master)](https://github.com/aeraki-mesh/aeraki/actions?query=branch%3Amaster+event%3Apush+workflow%3A%22e2e-redis%22)\n[![FOSSA Status](https://app.fossa.com/api/projects/git%2Bgithub.com%2Faeraki-mesh%2Faeraki.svg?type=shield)](https://app.fossa.com/projects/git%2Bgithub.com%2Faeraki-mesh%2Faeraki?ref=badge_shield)\n\n\u003ca href=\"https://aeraki.net/\"\u003e\n    \u003cimg src=\"docs/aeraki-log.png\"\n         width=\"130\"\n         alt=\"Aeraki logo\" title=\"Istio\" /\u003e\n\u003c/a\u003e\n\n---\n# Manage **any** layer-7 traffic in a service mesh!\n\n**Aeraki** [Air-rah-ki] is the Greek word for 'breeze'. While service mesh becomes an important infrastructure for microservices, many(if not all) service mesh implementations mainly focus on HTTP protocols and treat other protocols as plain TCP traffic. Aeraki Mesh is created to provide a non-intrusive, highly extendable way to manage any layer-7 traffic in a service mesh.\n\nNote: Aeraki only handles non-HTTP layer-7 traffic in a service mesh, and leaves the HTTP traffic to other existing service mesh projects. (As they have already done a very good job on it, and we don't want to reinvent the wheel! )\nAeraki currently can be integrated with Istio, and it may support other service mesh projects in the future.\n\n## Problems to solve\n\nWe are facing some challenges in service meshes:\n* Istio and other popular service mesh implementations have very limited support for layer-7 protocols other than HTTP and gRPC.\n* Envoy RDS(Route Discovery Service) is solely designed for HTTP. Other protocols such as Dubbo and Thrift can only use listener in-line routes for traffic management, which breaks existing connections when routes change.\n* It takes a lot of effort to introduce a proprietary protocol into a service mesh. You’ll need to write an Envoy filter to handle the traffic in the data plane, and a control plane to manage those Envoy proxies.\n\nThose obstacles make it very hard, if not impossible, for users to manage the traffic of other widely-used layer-7 protocols in microservices. For example, in a microservices application, we may have the below protocols:\n\n* RPC: HTTP, gRPC, Thrift, Dubbo, Proprietary RPC Protocol …\n* Messaging: Kafka, RabbitMQ …\n* Cache: Redis, Memcached …\n* Database: MySQL, PostgreSQL, MongoDB …\n\n![ Common Layer 7 Protocols Used in Microservices ](docs/protocols.png)\n\nIf you have already invested a lot of effort in migrating to a service mesh, of course, you want to get the most out of it — managing the traffic of all the protocols in your microservices.\n\n## Aeraki's approach\n\nTo address these problems, Aeraki Mesh provides a non-intrusive, extendable way to manage any layer-7 traffic in a service mesh.\n![ Aeraki ](docs/aeraki-architecture.png)\n\nAs this diagram shows, Aeraki Mesh consists of the following components:\n\n* Aeraki: [Aeraki](https://github.com/aeraki-mesh/aeraki) provides high-level, user-friendly traffic management rules to operations, translates the rules to envoy filter configurations, and leverages Istio’s `EnvoyFilter` API to push the configurations to the sidecar proxies. Aeraki also serves as the RDS server for MetaProtocol proxies in the data plane. Contrary to Envoy RDS, which focuses on HTTP, Aeraki RDS is aimed to provide a general dynamic route capability for all layer-7 protocols.\n* MetaProtocol Proxy: [MetaProtocol Proxy](https://github.com/aeraki-mesh/meta-protocol-proxy) provides common capabilities for Layer-7 protocols, such as load balancing, circuit breaker, routing, rate limiting, fault injection, and auth. Layer-7 protocols can be built on top of MetaProtocol. To add a new protocol into the service mesh, the only thing you need to do is to implement the [codec interface](https://github.com/aeraki-mesh/meta-protocol-proxy/blob/ac788327239bd794e745ce18b382da858ddf3355/src/meta_protocol_proxy/codec/codec.h#L118) and a couple of lines of configuration. If you have special requirements which can’t be accommodated by the built-in capabilities, MetaProtocol Proxy also has an application-level filter chain mechanism, allowing users to write their own layer-7 filters to add custom logic into MetaProtocol Proxy.\n\n[Dubbo](https://github.com/aeraki-mesh/meta-protocol-proxy/tree/master/src/application_protocols/dubbo) \n, [Thrift](https://github.com/aeraki-mesh/meta-protocol-proxy/tree/master/src/application_protocols/thrift) \n, [bRPC](https://github.com/aeraki-mesh/meta-protocol-proxy/tree/master/src/application_protocols/brpc)\nand [a number of other protocols](https://github.com/aeraki-mesh/aeraki/issues/105) have been implemented based on MetaProtocol. More protocols are on the way. \nIf you're using a close-source, proprietary protocol, you can also manage it in your service mesh simply by \n[writing a MetaProtocol codec](https://www.aeraki.net/docs/v1.x/tutorials/implement-a-custom-protocol/) for it.\n\nMost request/response style, stateless protocols can be built on top of the MetaProtocol Proxy. However, some protocols' routing policies are too \"special\" to be normalized in MetaProtocol. For example, the Redis proxy uses a slot number to map a client query to a specific Redis server node, and the slot number is computed by the key in the request. Aeraki can still manage those protocols as long as there's an available Envoy Filter in the Envoy proxy side. Currently, for protocols in this category, [Redis](https://github.com/aeraki-mesh/aeraki/blob/master/docs/zh/redis.md) and Kafka are supported in Aeraki.\n\n## Supported protocols:\nAeraki can manage the below protocols in a service mesh：\n* Dubbo (Envoy native filter）\n* Thrift (Envoy native filter)\n* Kafka (Envoy native filter)\n* Redis (Envoy native filter)\n* MetaProtocol-Dubbo\n* MetaProtocol-Thrift\n* MetaProtocol-bRPC (A RPC protocol open-source by Baidu)\n* MetaProtocol-tRPC (A proprietary RPC protocol used in Tencent）\n* MetaProtocol-qza (A proprietary protocol used in Tencent Music)\n* MetaProtocol-videoPacket (A proprietary protocol used in Tencent Media Data Platform)\n* MetaProtocol-Others: Alauda, Tencent iGame...\n* MetaProtocol-Private protocols: Have a private protocol? No problem, any layer-7 protocols built on top of the [MetaProtocol](https://github.com/aeraki-mesh/meta-protocol-proxy) can be managed by Aeraki\n\n## Supported Features:\n  * Traffic Management\n    * [x] Request Level Load Balancing/Locality Load Balancing (Supports Consistent Hash/Sticky Session)\n    * [x] Circuit breaking\n    * [x] Flexible Route Match Conditions (any properties can be exacted from layer-7 packets and used as match conditions)\n    * [x] Dynamic route update through Aeraki MetaRDS\n    * [x] Version Based Routing\n    * [x] Traffic Splitting\n    * [x] Local Rate Limit\n    * [x] Global Rate Limit\n    * [x] Message mutation\n    * [x] Traffic Mirroring\n  * Observability\n    * [x] Request level Metrics (Request latency, count, error, etc)\n    * [x] Distributed Tracing\n    * [x] Access log\n  * Security \n    * [x] Peer Authorization on Interface/Method\n    * [ ] Request Authorization\n\n\u003e Note: Protocols built on top of MetaProtocol support all the above features in Aeraki Mesh, Envoy native filters only support some of the above features, depending on the capacities of the native filters.\n\n## Demo\n\nhttps://www.aeraki.net/docs/v1.x/quickstart/\n\n## Install\n\nhttps://www.aeraki.net/docs/v1.x/install/\n\n## Build\n\n### Pre-requirements:\n* Golang Version \u003e= 1.16, and related golang tools installed like `goimports`, `gofmt`, etc.\n* Docker and Docker-Compose installed\n\n### Build Aeraki Binary\n\n```bash\n# build aeraki binary on Linux\nmake build\n\n# build aeraki binary on darwin\nmake build IMAGE_OS=darwin\n```\n\n### Build Aeraki Image\n\n```bash\n# build aeraki docker image with the default latest tag\nmake docker-build\n\n# build aeraki docker image with xxx tag\nmake docker-build IMAGE_TAG=xxx\n\n# build aeraki e2e docker image\nmake docker-build-e2e\n```\n\n## Contribute to Aeraki\n\nIf you're interested in contributing to this project, please read [Contributing to Aeraki](CONTRIBUTING.md).\n\n## Talks\n\n* IstioCon 2022: [Tencent Music’s service mesh practice with Istio and Aeraki](https://events.istio.io/istiocon-2022/sessions/tencent-music-aeraki/)\n* Istio meetup China(中文): [全栈服务网格 - Aeraki 助你在 Istio 服务网格中管理任何七层流量](https://www.youtube.com/watch?v=Bq5T3OR3iTM) \n* IstioCon 2021: [How to Manage Any Layer-7 Traffic in an Istio Service Mesh?](https://www.youtube.com/watch?v=sBS4utF68d8)\n\n## Who is using Aeraki?\n\nSincerely thank everyone for choosing, contributing, and using Aeraki. We created this issue to collect the use cases so we can drive the Aeraki community to evolve in the right direction and better serve your real-world scenarios. We encourage you to submit a comment on this issue to include your use case：https://github.com/aeraki-mesh/aeraki/issues/105\n\n## Contact\n* WeChat Group: Please contact Wechat ID: zhao_huabing to join the Aeraki Wechat group\n* Slack Channel: Join [our slack channel](https://cloud-native.slack.com/messages/aeraki-mesh)\n* Community meetings: [Meetings and recordings](https://www.aeraki.net/community/#community-meetings)\n\n## License\n\nThis project is licensed under [Apache 2.0 License](LICENSE)\n\n## Conduct\n\nWe follow the [CNCF Code of Conduct](CODE_OF_CONDUCT.md)\n\n## Landscapes\n\n\u003cp align=\"center\"\u003e\n\u003cimg src=\"https://landscape.cncf.io/images/cncf-landscape-horizontal-color.svg\" width=\"300\"/\u003e\n\u003cbr/\u003e\u003cbr/\u003e\nAeraki Mesh is a \u003ca href=\"https://landscape.cncf.io/?selected=aeraki-mesh\u0026item=orchestration-management--service-mesh--aeraki-mesh\"\u003eCNCF sandbox project.\u003c/a\u003e\n\u003c/p\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faeraki-mesh%2Faeraki","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Faeraki-mesh%2Faeraki","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faeraki-mesh%2Faeraki/lists"}