{"id":13523512,"url":"https://github.com/alibaba/higress","last_synced_at":"2026-02-21T16:03:52.865Z","repository":{"id":62143303,"uuid":"558188628","full_name":"alibaba/higress","owner":"alibaba","description":"🤖 AI Gateway | AI Native API Gateway","archived":false,"fork":false,"pushed_at":"2025-05-08T08:18:53.000Z","size":37086,"stargazers_count":5243,"open_issues_count":410,"forks_count":662,"subscribers_count":55,"default_branch":"main","last_synced_at":"2025-05-08T23:44:52.595Z","etag":null,"topics":["ai-gateway","ai-native","api-gateway","cloud-native","envoy"],"latest_commit_sha":null,"homepage":"https://higress.io","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/alibaba.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING_CN.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":"CODEOWNERS","security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2022-10-27T03:53:00.000Z","updated_at":"2025-05-08T19:19:49.000Z","dependencies_parsed_at":"2023-09-23T06:58:03.710Z","dependency_job_id":"d8b65d78-1750-49f5-9ae7-2eda7f88ae32","html_url":"https://github.com/alibaba/higress","commit_stats":{"total_commits":562,"total_committers":71,"mean_commits":7.915492957746479,"dds":0.5320284697508897,"last_synced_commit":"6a40d83ec0a04026238fd90ca315c5323a24c14a"},"previous_names":[],"tags_count":66,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/alibaba%2Fhigress","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/alibaba%2Fhigress/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/alibaba%2Fhigress/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/alibaba%2Fhigress/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/alibaba","download_url":"https://codeload.github.com/alibaba/higress/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":253514436,"owners_count":21920330,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai-gateway","ai-native","api-gateway","cloud-native","envoy"],"created_at":"2024-08-01T06:01:00.744Z","updated_at":"2026-02-21T16:03:52.857Z","avatar_url":"https://github.com/alibaba.png","language":"Go","funding_links":[],"categories":["Cloud \u0026 DevOps MCP Servers","服务器实现","Go","☁️ Cloud Platforms \u0026 Infrastructure","Repos","语言资源库","语音识别与合成_其他","Gateway","APIs and HTTP Requests","3）参考实现与开源工具（GitHub）","Inference","API Gateways \u0026 Proxies","MCP Utilities \u0026 Tools","3. Inference Engines \u0026 Serving","Table of Contents"],"sub_categories":["系统与硬件","Tools","go","资源传输下载","AI Native 工具","AI Gateway","Gateways","AI Services"],"readme":"\u003ca name=\"readme-top\"\u003e\u003c/a\u003e\n\u003ch1 align=\"center\"\u003e\n    \u003cimg src=\"https://img.alicdn.com/imgextra/i2/O1CN01NwxLDd20nxfGBjxmZ_!!6000000006895-2-tps-960-290.png\" alt=\"Higress\" width=\"240\" height=\"72.5\"\u003e\n  \u003cbr\u003e\n  AI Gateway\n\u003c/h1\u003e\n\u003ch4 align=\"center\"\u003e AI Native API Gateway \u003c/h4\u003e\n\n\u003cdiv align=\"center\"\u003e\n    \n[![Build Status](https://github.com/alibaba/higress/actions/workflows/build-and-test.yaml/badge.svg?branch=main)](https://github.com/alibaba/higress/actions)\n[![license](https://img.shields.io/github/license/alibaba/higress.svg)](https://www.apache.org/licenses/LICENSE-2.0.html)\n[![discord](https://img.shields.io/discord/1364956090566971515?color=5865F2\u0026label=discord\u0026labelColor=black\u0026logo=discord\u0026logoColor=white\u0026style=flat-square)](https://discord.gg/tSbww9VDaM)\n\n\u003ca href=\"https://trendshift.io/repositories/10918\" target=\"_blank\"\u003e\u003cimg src=\"https://trendshift.io/api/badge/repositories/10918\" alt=\"alibaba%2Fhigress | Trendshift\" style=\"width: 250px; height: 55px;\" width=\"250\" height=\"55\"/\u003e\u003c/a\u003e \u003ca href=\"https://www.producthunt.com/posts/higress?embed=true\u0026utm_source=badge-featured\u0026utm_medium=badge\u0026utm_souce=badge-higress\" target=\"_blank\"\u003e\u003cimg src=\"https://api.producthunt.com/widgets/embed-image/v1/featured.svg?post_id=951287\u0026theme=light\u0026t=1745492822283\" alt=\"Higress - Global\u0026#0032;APIs\u0026#0032;as\u0026#0032;MCP\u0026#0032;powered\u0026#0032;by\u0026#0032;AI\u0026#0032;Gateway | Product Hunt\" style=\"width: 250px; height: 54px;\" width=\"250\" height=\"54\" /\u003e\u003c/a\u003e\n\n\u003c/div\u003e\n\n[**Official Site**](https://higress.ai/en/) \u0026nbsp; |\n\u0026nbsp; [**Docs**](https://higress.cn/en/docs/latest/overview/what-is-higress/) \u0026nbsp; |\n\u0026nbsp; [**Blog**](https://higress.cn/en/blog/) \u0026nbsp; |\n\u0026nbsp; [**MCP Server QuickStart**](https://higress.cn/en/ai/mcp-quick-start/) \u0026nbsp; |\n\u0026nbsp; [**Developer Guide**](https://higress.cn/en/docs/latest/dev/architecture/) \u0026nbsp; |\n\u0026nbsp; [**Wasm Plugin Hub**](https://higress.cn/en/plugin/) \u0026nbsp; |\n\n\u003cp\u003e\n   English | \u003ca href=\"README_ZH.md\"\u003e中文\u003c/a\u003e | \u003ca href=\"README_JP.md\"\u003e日本語\u003c/a\u003e\n\u003c/p\u003e\n\n## What is Higress?\n\nHigress is a cloud-native API gateway based on Istio and Envoy, which can be extended with Wasm plugins written in Go/Rust/JS. It provides dozens of ready-to-use general-purpose plugins and an out-of-the-box console (try the [demo here](http://demo.higress.io/)).\n\n### Core Use Cases\n\nHigress's AI gateway capabilities support all [mainstream model providers](https://github.com/alibaba/higress/tree/main/plugins/wasm-go/extensions/ai-proxy/provider) both domestic and international. It also supports hosting MCP (Model Context Protocol) Servers through its plugin mechanism, enabling AI Agents to easily call various tools and services. With the [openapi-to-mcp tool](https://github.com/higress-group/openapi-to-mcpserver), you can quickly convert OpenAPI specifications into remote MCP servers for hosting. Higress provides unified management for both LLM API and MCP API. \n\n**🌟 Try it now at [https://mcp.higress.ai/](https://mcp.higress.ai/)** to experience Higress-hosted Remote MCP Servers firsthand:\n\n![Higress MCP Server Platform](https://img.alicdn.com/imgextra/i2/O1CN01nmVa0a1aChgpyyWOX_!!6000000003294-0-tps-3430-1742.jpg)\n\n### Enterprise Adoption\n\nHigress was born within Alibaba to solve the issues of Tengine reload affecting long-connection services and insufficient load balancing capabilities for gRPC/Dubbo. Within Alibaba Cloud, Higress's AI gateway capabilities support core AI applications such as Tongyi Bailian model studio, machine learning PAI platform, and other critical AI services. Alibaba Cloud has built its cloud-native API gateway product based on Higress, providing 99.99% gateway high availability guarantee service capabilities for a large number of enterprise customers.\n\nYou can click the button below to install the enterprise version of Higress:\n\n[![Deploy on AlibabaCloud](https://img.alicdn.com/imgextra/i1/O1CN01e6vwe71EWTHoZEcpK_!!6000000000359-55-tps-170-40.svg)](https://www.aliyun.com/product/api-gateway?spm=higress-github.topbar.0.0.0)\n\n\nIf you use open-source Higress and wish to obtain enterprise-level support, you can contact the project maintainer johnlanni's email: **zty98751@alibaba-inc.com** or social media accounts (WeChat ID: **nomadao**, DingTalk ID: **chengtanzty**). Please note **Higress** when adding as a friend :)\n\n## Summary\n\n- [**Quick Start**](#quick-start)    \n- [**Feature Showcase**](#feature-showcase)\n- [**Use Cases**](#use-cases)\n- [**Core Advantages**](#core-advantages)\n- [**Community**](#community)\n\n## Quick Start\n\nHigress can be started with just Docker, making it convenient for individual developers to set up locally for learning or for building simple sites:\n\n```bash\n# Create a working directory\nmkdir higress; cd higress\n# Start higress, configuration files will be written to the working directory\ndocker run -d --rm --name higress-ai -v ${PWD}:/data \\\n        -p 8001:8001 -p 8080:8080 -p 8443:8443  \\\n        higress-registry.cn-hangzhou.cr.aliyuncs.com/higress/all-in-one:latest\n```\n\nPort descriptions:\n\n- Port 8001: Higress UI console entry\n- Port 8080: Gateway HTTP protocol entry\n- Port 8443: Gateway HTTPS protocol entry\n\n\u003e All Higress Docker images use Higress's own image repository and are not affected by Docker Hub rate limits.\n\u003e In addition, the submission and updates of the images are protected by a security scanning mechanism (powered by Alibaba Cloud ACR), making them very secure for use in production environments.\n\u003e \n\u003e If you experience a timeout when pulling image from `higress-registry.cn-hangzhou.cr.aliyuncs.com`, you can try replacing it with the following docker registry mirror source:\n\u003e \n\u003e **North America**: `higress-registry.us-west-1.cr.aliyuncs.com`\n\u003e \n\u003e **Southeast Asia**: `higress-registry.ap-southeast-7.cr.aliyuncs.com`\n\n\u003e **For Kubernetes deployments**, you can configure the `global.hub` parameter in Helm values to use a mirror registry closer to your region. This applies to both Higress component images and built-in Wasm plugin images:\n\u003e \n\u003e ```bash\n\u003e # Example: Using North America mirror\n\u003e helm install higress -n higress-system higress.io/higress --set global.hub=higress-registry.us-west-1.cr.aliyuncs.com --create-namespace\n\u003e ```\n\u003e \n\u003e Available mirror registries:\n\u003e - **China (Hangzhou)**: `higress-registry.cn-hangzhou.cr.aliyuncs.com` (default)\n\u003e - **North America**: `higress-registry.us-west-1.cr.aliyuncs.com`\n\u003e - **Southeast Asia**: `higress-registry.ap-southeast-7.cr.aliyuncs.com`\n\nFor other installation methods such as Helm deployment under K8s, please refer to the official [Quick Start documentation](https://higress.io/en-us/docs/user/quickstart).\n\nIf you are deploying on the cloud, it is recommended to use the [Enterprise Edition](https://www.aliyun.com/product/apigateway?spm=higress-github.topbar.0.0.0)\n\n\n## Use Cases\n\n- **MCP Server Hosting**:\n\n  Higress hosts MCP Servers through its plugin mechanism, enabling AI Agents to easily call various tools and services. With the [openapi-to-mcp tool](https://github.com/higress-group/openapi-to-mcpserver), you can quickly convert OpenAPI specifications into remote MCP servers.\n\n  ![](https://img.alicdn.com/imgextra/i1/O1CN01wv8H4g1mS4MUzC1QC_!!6000000004952-2-tps-1764-597.png)\n\n  Key benefits of hosting MCP Servers with Higress:\n  - Unified authentication and authorization mechanisms\n  - Fine-grained rate limiting to prevent abuse\n  - Comprehensive audit logs for all tool calls\n  - Rich observability for monitoring performance\n  - Simplified deployment through Higress's plugin mechanism\n  - Dynamic updates without disruption or connection drops\n\n     [Learn more...](https://higress.cn/en/ai/mcp-quick-start/?spm=36971b57.7beea2de.0.0.d85f20a94jsWGm)\n\n- **AI Gateway**:\n\n  Higress connects to all LLM model providers using a unified protocol, with AI observability, multi-model load balancing, token rate limiting, and caching capabilities:\n\n  ![](https://img.alicdn.com/imgextra/i2/O1CN01izmBNX1jbHT7lP3Yr_!!6000000004566-0-tps-1920-1080.jpg)\n\n- **Kubernetes ingress controller**:\n\n  Higress can function as a feature-rich ingress controller, which is compatible with many annotations of K8s' nginx ingress controller.\n  \n  [Gateway API](https://gateway-api.sigs.k8s.io/) is already supported, and it supports a smooth migration from Ingress API to Gateway API.\n\n  Compared to ingress-nginx, the resource overhead has significantly decreased, and the speed at which route changes take effect has improved by ten times.\n\n  \u003e The following resource overhead comparison comes from [sealos](https://github.com/labring).\n  \u003e\n  \u003e For details, you can read this [article](https://sealos.io/blog/sealos-envoy-vs-nginx-2000-tenants) to understand how sealos migrates the monitoring of **tens of thousands of ingress** resources from nginx ingress to higress.\n\n   ![](https://img.alicdn.com/imgextra/i1/O1CN01bhEtb229eeMNBWmdP_!!6000000008093-2-tps-750-547.png)\n\n  \n- **Microservice gateway**:\n\n  Higress can function as a microservice gateway, which can discovery microservices from various service registries, such as Nacos, ZooKeeper, Consul, Eureka, etc.\n  \n  It deeply integrates with [Dubbo](https://github.com/apache/dubbo), [Nacos](https://github.com/alibaba/nacos), [Sentinel](https://github.com/alibaba/Sentinel) and other microservice technology stacks.\n  \n- **Security gateway**:\n\n  Higress can be used as a security gateway, supporting WAF and various authentication strategies, such as key-auth, hmac-auth, jwt-auth, basic-auth, oidc, etc.\n\n\n## Core Advantages\n\n- **Production Grade**\n\n  Born from Alibaba's internal product with over 2 years of production validation, supporting large-scale scenarios with hundreds of thousands of requests per second.\n\n  Completely eliminates traffic jitter caused by Nginx reload, configuration changes take effect in milliseconds and are transparent to business. Especially friendly to long-connection scenarios such as AI businesses.\n\n- **Streaming Processing**\n\n  Supports true complete streaming processing of request/response bodies, Wasm plugins can easily customize the handling of streaming protocols such as SSE (Server-Sent Events).\n\n  In high-bandwidth scenarios such as AI businesses, it can significantly reduce memory overhead.\n    \n- **Easy to Extend**\n  \n  Provides a rich official plugin library covering AI, traffic management, security protection and other common functions, meeting more than 90% of business scenario requirements.\n\n  Focuses on Wasm plugin extensions, ensuring memory safety through sandbox isolation, supporting multiple programming languages, allowing plugin versions to be upgraded independently, and achieving traffic-lossless hot updates of gateway logic.\n\n- **Secure and Easy to Use**\n  \n  Based on Ingress API and Gateway API standards, provides out-of-the-box UI console, WAF protection plugin, IP/Cookie CC protection plugin ready to use.\n\n  Supports connecting to Let's Encrypt for automatic issuance and renewal of free certificates, and can be deployed outside of K8s, started with a single Docker command, convenient for individual developers to use.\n\n## Community\n\nJoin our Discord community! This is where you can connect with developers and other enthusiastic users of Higress.\n\n[![discord](https://img.shields.io/discord/1364956090566971515?color=5865F2\u0026label=discord\u0026labelColor=black\u0026logo=discord\u0026logoColor=white\u0026style=for-the-badge)](https://discord.gg/tSbww9VDaM)\n\n\n### Thanks\n\nHigress would not be possible without the valuable open-source work of projects in the community. We would like to extend a special thank you to Envoy and Istio.\n\n### Related Repositories\n\n- Higress Console: https://github.com/higress-group/higress-console\n- Higress Standalone: https://github.com/higress-group/higress-standalone\n- Higress Plugin Server：https://github.com/higress-group/plugin-server\n- Higress Wasm Plugin Golang SDK：https://github.com/higress-group/wasm-go\n\n### Contributors\n\n\u003ca href=\"https://github.com/alibaba/higress/graphs/contributors\"\u003e\n  \u003cimg alt=\"contributors\" src=\"https://contrib.rocks/image?repo=alibaba/higress\"/\u003e\n\u003c/a\u003e\n\n### Star History\n\n[![Star History Chart](https://api.star-history.com/svg?repos=alibaba/higress\u0026type=Date)](https://star-history.com/#alibaba/higress\u0026Date)\n\n\u003cp align=\"right\" style=\"font-size: 14px; color: #555; margin-top: 20px;\"\u003e\n    \u003ca href=\"#readme-top\" style=\"text-decoration: none; color: #007bff; font-weight: bold;\"\u003e\n        ↑ Back to Top ↑\n    \u003c/a\u003e\n\u003c/p\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Falibaba%2Fhigress","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Falibaba%2Fhigress","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Falibaba%2Fhigress/lists"}