{"id":19327541,"url":"https://github.com/deepflowio/df-evaluation","last_synced_at":"2026-06-13T13:32:58.083Z","repository":{"id":239691244,"uuid":"800268377","full_name":"deepflowio/df-evaluation","owner":"deepflowio","description":"automation test and evaluate system","archived":false,"fork":false,"pushed_at":"2024-05-14T06:37:58.000Z","size":225,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":3,"default_branch":"main","last_synced_at":"2024-05-15T12:26:26.315Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/deepflowio.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-05-14T02:38:12.000Z","updated_at":"2024-06-19T10:19:05.017Z","dependencies_parsed_at":null,"dependency_job_id":"0b26e3c0-1bb0-462d-a24b-0d35cb290fb0","html_url":"https://github.com/deepflowio/df-evaluation","commit_stats":null,"previous_names":["deepflowio/df-evaluation"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/deepflowio/df-evaluation","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepflowio%2Fdf-evaluation","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepflowio%2Fdf-evaluation/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepflowio%2Fdf-evaluation/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepflowio%2Fdf-evaluation/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/deepflowio","download_url":"https://codeload.github.com/deepflowio/df-evaluation/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepflowio%2Fdf-evaluation/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34286975,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-13T02:00:06.617Z","response_time":62,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-10T02:17:32.274Z","updated_at":"2026-06-13T13:32:58.063Z","avatar_url":"https://github.com/deepflowio.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"## 1. Evaluation 功能\n- 接收页面请求参数，包含测试例名称（测试场景）、待测agent类型等参数\n- 根据场景搭建测试环境并执行测试例\n- 收集环境、业务、agent的各项资源消耗以及服务指标\n- 整理结果并输出\n## 2. 软件架构\nevaluation主要由evaluation进程和runner进程构成。evaluation进程主要负责webapi的接收、runner的调度、测试结果的整合输出。runner进程主要负责测试用例的执行，根据参数初始化测试环境，执行指定测试用例，保存测试结果。\n![alt text](image.png)\n## 3. 调用流程\nweb发送测试请求到Api-Server，Server将发送给Manager，Manage创建Runner子进程执行用例，测试执行完后Manager整合结果向外输出。\n![alt text](image-1.png)\n## 4. 代码框架\n### 1. manager\n调度进程\n- 测试runner的创建\n- 测试状态的监控和日志输出\n- 测试结果的汇总的输出\n- 测试请求的接收，排队\n### 2. Runner\n测试例执行进程\n#### 2.1 agent-tools\n各类采集器的调度类，每种采集器的tools需实现以下功能接口\n- 创建、删除\n- 启动、停止\n- 状态正常检查\n- 性能规格限制（cpu mem ...）\n- 各指标获取（cpu占用 内存占用 ...）\n- 配置写入\n#### 2.2 cases\n测试例的具体流程，实现以下场景：\n- 极端高性能的业务场景（nginx-default-page）下部署agent前后性能表现\n- 典型云原生微服务场景（istio-bookinfo-demo）下部署agent前后性能表现\n- ...\n#### 2.3 platform-tools\n- Platform sdk base，每种云平台需实现该基类接口\n  - 创建、删除虚拟机\n  - 启动、停止虚拟机\n  - 获取ip\n  - 获取状态\n- Aliyun sdk\n### 3. Api-server\nHttp server 用于接收页面请求3","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdeepflowio%2Fdf-evaluation","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdeepflowio%2Fdf-evaluation","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdeepflowio%2Fdf-evaluation/lists"}