{"id":13870710,"url":"https://github.com/WeBankFinTech/Streamis","last_synced_at":"2025-07-15T22:30:55.867Z","repository":{"id":37801176,"uuid":"351376735","full_name":"WeBankFinTech/Streamis","owner":"WeBankFinTech","description":"Streaming application development and management system, based on Linkis and DSS, planning to provide the workflow-like graphical drag-and-drop development capability.","archived":false,"fork":false,"pushed_at":"2025-04-25T05:10:21.000Z","size":75658,"stargazers_count":107,"open_issues_count":62,"forks_count":44,"subscribers_count":19,"default_branch":"main","last_synced_at":"2025-04-25T06:24:16.562Z","etag":null,"topics":["datalake","dataspherestudio","deltalake","flink","hudi","iceberg","kafka","linkis","streaming","streamis","warehouse","wedatasphere"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/WeBankFinTech.png","metadata":{"files":{"readme":"README-ZH.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-03-25T09:23:29.000Z","updated_at":"2025-04-25T05:10:16.000Z","dependencies_parsed_at":"2024-06-18T08:09:17.135Z","dependency_job_id":null,"html_url":"https://github.com/WeBankFinTech/Streamis","commit_stats":null,"previous_names":[],"tags_count":3,"template":false,"template_full_name":null,"purl":"pkg:github/WeBankFinTech/Streamis","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WeBankFinTech%2FStreamis","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WeBankFinTech%2FStreamis/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WeBankFinTech%2FStreamis/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WeBankFinTech%2FStreamis/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/WeBankFinTech","download_url":"https://codeload.github.com/WeBankFinTech/Streamis/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WeBankFinTech%2FStreamis/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265464842,"owners_count":23770336,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["datalake","dataspherestudio","deltalake","flink","hudi","iceberg","kafka","linkis","streaming","streamis","warehouse","wedatasphere"],"created_at":"2024-08-05T21:00:50.601Z","updated_at":"2025-07-15T22:30:53.469Z","avatar_url":"https://github.com/WeBankFinTech.png","language":"Java","funding_links":[],"categories":["Java","大数据"],"sub_categories":[],"readme":"# Streamis\n\n[![License](https://img.shields.io/badge/license-Apache%202-4EB1BA.svg)](https://www.apache.org/licenses/LICENSE-2.0.html)\n\n[English](README.md) | 中文\n\n## 引言\n\n \u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;Streamis 是 **微众银行** 联合 **天翼云**、**仙翁科技** 和 **萨摩耶云** 联合共建的流式应用开发管理系统。\n\n \u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;基于 [DataSphere Studio](https://github.com/WeBankFinTech/DataSphereStudio) 的框架化能力，以及底层对接 [Linkis](https://github.com/apache/incubator-linkis) 的 **Flink 引擎**，让用户低成本完成流式应用的开发、调试、发布和生产管理。\n \n \u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;未来还规划将以工作流式的图形化拖拽开发体验，将流式应用以Source节点、\nDimension节点、Transform节点、Sink节点 和 [Visualis](https://github.com/WeBankFinTech/Visualis) 节点串连成一条流式工作流，让用户以更低的学习成本完成流式应用的开发、调试和发布。\n\n----\n\n## 核心特点\n\n#### 1. 基于 DSS 和 Linkis，打造领先的流式应用开发管理系统。\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;以 Flink 为底层计算引擎，基于开发中心和生产中心隔离的架构设计模式，完全隔离开发权限与发布权限，隔离开发环境与生产环境，保证业务应用的高稳定性和高安全性。\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;应用开发层与 DSS 的数据应用开发流程有机整合，提供极简的用户使用体验。\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;应用执行层集成 Linkis 计算中间件，打造金融级具备高并发、高可用、多租户隔离和资源管控等能力的流式应用管理能力。\n\n#### 2. 强大的流式应用开发调试能力。\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;基于 DSS-Scriptis 提供流式应用的开发和调试功能，支持对 FlinkSQL 进行实时调试和结果集展示。\n\n![流式开发中心](docs/images/开发中心.png)\n\n#### 3. 强大的流式应用生产中心能力。\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;支持流式作业的多版本管理、全生命周期管理、监控告警、checkpoint 和 savepoint 管理能力。\n\n![流式应用生产](docs/images/stream_product_center.png)\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;流式应用运行情况：\n\n![流式应用运行情况](docs/images/stream_job_detail.png)\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;流式应用参数配置：\n\n![流式应用配置](docs/images/stream_job_config_1.png)\n![流式应用配置](docs/images/stream_job_config_2.png)\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;更多功能，请参考：[Streamis 用户手册](docs/zh_CN/使用文档/Streamis用户手册.md)。\n\n----\n\n## 依赖的生态组件\n\n| 依赖的应用工具    | 描述                                                         | Streamis 兼容版本 |\n|--------------|---------------------------------------------------------------|---------------------------------------------|\n| [DataSphereStudio](https://github.com/WeBankFinTech/DataSphereStudio) | 数据应用开发管理集成框架。以工作流式的图形化拖拽开发体验，将满足从数据交换、脱敏清洗、分析挖掘、质量检测、可视化展现、定时调度到数据输出应用等，数据应用开发全流程场景需求。 | \u0026gt;= DSS1.1.2（已发布）                         |\n| [Linkis](https://github.com/apache/incubator-linkis) | 计算中间件 Apache Linkis，通过提供 REST/WebSocket/JDBC/SDK 等标准接口，上层应用可以方便地连接访问 MySQL/Spark/Hive/Presto/Flink 等底层引擎。 | \u0026gt;= Linkis1.4.0（已发布） |\n\n----\n\n## Demo试用环境\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;正在部署中，敬请期待！\n\n----\n\n## 下载\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;请前往 [Streamis releases](https://github.com/WeBankFinTech/Streamis/releases) 页面下载 Streamis 的已编译版本或源码包。\n\n----\n\n## 编译和安装部署\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;请参考 [Streamis 安装部署文档](docs/zh_CN/安装文档/Streamis安装文档.md) ，用于安装部署 Streamis 及其依赖环境。\n\n\n----\n\n## 示例和使用指引\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;请到 [用户使用文档](docs/zh_CN/使用文档/Streamis用户手册.md) ，了解如何快速使用 Streamis。\n\n----\n\n## Streamis 功能介绍\n \n| 功能模组 | 描述 | Streamis | \n | :----: | :----: |-------|\n | 安装部署 | 部署难易程度和第三方依赖 | 一键部署，依赖Linkis Flink引擎 |\n | 开发中心| FlinkSQL 流式应用实时开发、调试 | 支持，需集成DSS | \n | 生产中心 | 流式应用管理运维能力 | 支持 |\n |       | 复用 Linkis 计算治理能力 | 支持 |\n |       | 支持 FlinkSQL 和 FlinkJar 包等方式发布 | 支持 |\n |       | 流式应用的多版本管理能力 | 支持 |\n |       | 流式应用的参数配置和告警能力 | 支持 |\n | 服务高可用 | 应用高可用，服务多点，状态快照实现容错处理，故障不影响使用 | 支持 | \n | 系统管理 | 节点、资源管理 | 支持 |\n |权限管理  |任务的操作权限控制 |支持 |\n \n----\n\n## 架构\n\n![架构](images/zh_CN/readme/architecture.png)\n\n----\n\n## 贡献\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;我们非常欢迎和期待更多的贡献者参与共建 Streamis, 不论是代码、文档，或是其他能够帮助到社区的贡献形式。\n\n## 联系我们\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;对 Streamis 的任何问题和建议，敬请提交 [issue](https://github.com/WeBankFinTech/Streamis/issues)，以便跟踪处理和经验沉淀共享。\n\n\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;您也可以扫描下面的二维码，加入我们的 微信群，以获得更快速的响应。\n\n![交流](images/zh_CN/readme/communication.png)\n\n----\n\n## License\n\n \u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;DSS is under the Apache 2.0 license. See the [License](LICENSE) file for details.\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FWeBankFinTech%2FStreamis","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FWeBankFinTech%2FStreamis","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FWeBankFinTech%2FStreamis/lists"}