{"id":13615805,"url":"https://github.com/smallnest/network_benchmark","last_synced_at":"2025-03-25T02:30:52.446Z","repository":{"id":144973280,"uuid":"577620949","full_name":"smallnest/network_benchmark","owner":"smallnest","description":"3百万QPS benchmark测试","archived":false,"fork":false,"pushed_at":"2023-05-31T04:30:45.000Z","size":4188,"stargazers_count":35,"open_issues_count":0,"forks_count":6,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-03-19T06:42:44.940Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/smallnest.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-12-13T06:29:42.000Z","updated_at":"2024-10-15T13:01:44.000Z","dependencies_parsed_at":null,"dependency_job_id":"4ee9e7f3-40d1-45ec-9cbb-90746ea78d8b","html_url":"https://github.com/smallnest/network_benchmark","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/smallnest%2Fnetwork_benchmark","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/smallnest%2Fnetwork_benchmark/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/smallnest%2Fnetwork_benchmark/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/smallnest%2Fnetwork_benchmark/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/smallnest","download_url":"https://codeload.github.com/smallnest/network_benchmark/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245385298,"owners_count":20606642,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-01T20:01:18.208Z","updated_at":"2025-03-25T02:30:51.289Z","avatar_url":"https://github.com/smallnest.png","language":"Go","funding_links":[],"categories":["Go"],"sub_categories":[],"readme":"# 单机百万级别QPS 网络传输\n\n\n\n**TLDR**:\n\n- **UDP**\n  \n  - 3万 qps的时候偶尔会有一两个丢包。\n  \n  - 5万 qps的时候丢包严重且频繁，不适合做可信赖的网络探测\n  \n  - 非可信赖的通讯情况下，可以达到接近百万的QPS\n\n- **TCP**\n  \n  - 3万 qps的时候丢包就比较严重了。TCP重传厉害\n  \n  - 非可信赖的通讯情况下，可以达到接近280万的QPS （理论还可以增加，但是client CPU已经100%了）\n\n\n**注意**： \"非可信赖\" 指的是可能会发生丢包情况，UDP程序要么忽略，要么通过一种机制进行重发。 TCP本身的重传机制可以保证数据不丢。\n\n\n\n## 1、背景\n\n测试两台机器之间UDP、TCP通讯的benchmark。\n\n主要探测两个场景\n\n- 满足可信赖的通讯的qps\n\n- 支持的最大qps\n\n\n\n## 2、环境设置\n\nclient和server连接到同一台Tor，尽量减少网络的干扰。\n\n\n\n**客户端机器**: xxx.xxx.xxx.xxx\n\nIntel(R) Xeon(R) Gold 5118 CPU @ 2.30GHz 两颗\n\n12物理核 48个逻辑核\n\n187GB内存\n\n\n\n**服务端机器**: xxx.xxx.xxx.xxx\n\nIntel(R) Xeon(R) Gold 5118 CPU @ 2.30GHz 两颗\n\n12物理核 48个逻辑核\n\n187GB内存\n\n\n\n设置了网卡多队列。\n\n\n\n## 3、UDP 百万 QPS 测试\n\n- 服务端端口 48 个\n\n- 客户端端口 48 个\n\n- 客户端和服务端端口按顺序建立\"连接\"\n\n\n\n**TLDR**: \n\n- 3万 qps的时候偶尔会有一两个丢包。\n\n- 5万 qps的时候丢包严重且频繁，不适合做可信赖的网络探测\n\n- 非可信赖的通讯情况下，可以达到接近百万的QPS\n\n\n\n### 3.1 3万 QPS 压测\n\n\u003cimg src=\"images/2022-12-14-14-08-40-image.png\" title=\"\" alt=\"\" width=\"621\"\u003e\n\nclient:\n\n\u003cimg src=\"images/2022-12-14-14-07-34-image.png\" title=\"\" alt=\"\" width=\"617\"\u003e\n\nserver:\n\n\u003cimg src=\"images/2022-12-14-14-08-20-image.png\" title=\"\" alt=\"\" width=\"617\"\u003e\n\n\n\n### 3.2 10万 QPS 压测\n\n\n\n\u003cimg src=\"images/2022-12-14-14-14-38-image.png\" title=\"\" alt=\"\" width=\"700\"\u003e\n\n\n\nclient:\n\n\u003cimg src=\"images/2022-12-14-14-13-08-image.png\" title=\"\" alt=\"\" width=\"707\"\u003e\n\n\n\nserver:\n\n\u003cimg src=\"images/2022-12-14-14-14-10-image.png\" title=\"\" alt=\"\" width=\"729\"\u003e\n\n\n\n\n\n\n\n### 3.3 100万 QPS 压测\n\n\n\n\u003cimg src=\"images/2022-12-14-14-19-20-image.png\" title=\"\" alt=\"\" width=\"625\"\u003e\n\nclient:\n\n\u003cimg src=\"images/2022-12-14-14-18-34-image.png\" title=\"\" alt=\"\" width=\"615\"\u003e\n\n\n\nserver:\n\n\u003cimg src=\"images/2022-12-14-14-19-02-image.png\" title=\"\" alt=\"\" width=\"619\"\u003e\n\n\n\n## 4、TCP 百万 QPS 测试\n\n\n\n- 服务端端口 48 个\n\n- 客户端端口 48 个\n\n- 客户端和服务端建立48条流\n\n\n\n**TLDR**:\n\n- 3万 qps的时候丢包就比较严重了。TCP重传厉害\n\n- 非可信赖的通讯情况下，可以达到接近280万的QPS （理论还可以增加，但是client CPU已经100%了）\n  \n  \n\n### 4.1  3万 QPS 压测\n\n\n##### 1. dstat\n\nclient:\n\n\u003cimg src=\"images/2022-12-14-12-35-24-image.png\" title=\"\" alt=\"\" width=\"558\"\u003e\n\n\n\nserver:\n\n\u003cimg src=\"images/2022-12-14-12-35-37-image.png\" title=\"\" alt=\"\" width=\"592\"\u003e\n\n\n\n##### 2. client log\n\n\u003cimg src=\"images/2022-12-14-12-28-05-image.png\" title=\"\" alt=\"\" width=\"590\"\u003e\n\n\n\n\n\n### 4.2 5万 QPS 压测\n\n\n##### 1. dstat\n\nclient:\n\n\u003cimg src=\"images/2022-12-14-12-17-26-image.png\" title=\"\" alt=\"\" width=\"502\"\u003e\n\n\n\nserver:\n\n\u003cimg src=\"images/2022-12-14-12-17-05-image.png\" title=\"\" alt=\"\" width=\"499\"\u003e\n\n\n\n##### 2. client log\n\n\u003cimg src=\"images/2022-12-14-12-16-29-image.png\" title=\"\" alt=\"\" width=\"422\"\u003e\n\n\n\n### 4.3 100万 QPS 压测\n\n\n##### 1. dstat\n\nclient:\n\n\u003cimg src=\"images/2022-12-14-11-53-52-image.png\" title=\"\" alt=\"\" width=\"749\"\u003e\n\nserver:\n\n\u003cimg src=\"images/2022-12-14-11-54-19-image.png\" title=\"\" alt=\"\" width=\"747\"\u003e\n\n\n\n##### 2. client log\n\n\u003cimg src=\"images/2022-12-14-11-54-50-image.png\" title=\"\" alt=\"\" width=\"610\"\u003e\n\n\n\n### 4.4 200万 QPS 压测\n\n##### 1. dstat\n\nclient:\n\n\u003cimg src=\"images/2022-12-14-11-40-21-image.png\" title=\"\" alt=\"\" width=\"580\"\u003e\n\nserver:\n\n\u003cimg src=\"images/2022-12-14-11-41-00-image.png\" title=\"\" alt=\"\" width=\"582\"\u003e\n\n\n\n##### 2. client log\n\n\u003cimg src=\"images/2022-12-14-11-41-19-image.png\" title=\"\" alt=\"\" width=\"646\"\u003e\n\n\n\n### 4.5 300万 QPS 压测\n\n##### 1. dstat\n\nclient: \n\n\u003cimg src=\"images/2022-12-14-11-27-18-image.png\" title=\"\" alt=\"\" width=\"598\"\u003e\n\nserver:\n\n\u003cimg src=\"images/2022-12-14-11-27-47-image.png\" title=\"\" alt=\"\" width=\"601\"\u003e\n\n\n##### 2. client log\n\n\u003cimg src=\"images/2022-12-14-11-26-40-image.png\" title=\"\" alt=\"\" width=\"609\"\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsmallnest%2Fnetwork_benchmark","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsmallnest%2Fnetwork_benchmark","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsmallnest%2Fnetwork_benchmark/lists"}