{"id":13487463,"url":"https://github.com/WeBankFinTech/Exchangis","last_synced_at":"2025-03-27T22:31:26.032Z","repository":{"id":37178028,"uuid":"262216608","full_name":"WeBankFinTech/Exchangis","owner":"WeBankFinTech","description":"Exchangis is a lightweight,highly extensible data exchange platform that supports data transmission between structured and unstructured heterogeneous data sources","archived":false,"fork":false,"pushed_at":"2024-06-27T09:14:23.000Z","size":43310,"stargazers_count":442,"open_issues_count":10,"forks_count":205,"subscribers_count":30,"default_branch":"master","last_synced_at":"2024-08-01T18:30:29.481Z","etag":null,"topics":["dataspherestudio","datax","etl","exchangis","flink","linkis","sqoop","transmission-engine","wedatasphere"],"latest_commit_sha":null,"homepage":"https://github.com/WeBankFinTech/Exchangis.git","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/WeBankFinTech.png","metadata":{"files":{"readme":"README-ZH.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-05-08T03:21:07.000Z","updated_at":"2024-07-18T10:09:24.000Z","dependencies_parsed_at":"2024-06-27T10:52:14.016Z","dependency_job_id":null,"html_url":"https://github.com/WeBankFinTech/Exchangis","commit_stats":null,"previous_names":[],"tags_count":5,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WeBankFinTech%2FExchangis","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WeBankFinTech%2FExchangis/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WeBankFinTech%2FExchangis/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WeBankFinTech%2FExchangis/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/WeBankFinTech","download_url":"https://codeload.github.com/WeBankFinTech/Exchangis/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":222322034,"owners_count":16966433,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["dataspherestudio","datax","etl","exchangis","flink","linkis","sqoop","transmission-engine","wedatasphere"],"created_at":"2024-07-31T18:00:59.693Z","updated_at":"2025-03-27T22:31:26.019Z","avatar_url":"https://github.com/WeBankFinTech.png","language":"Java","funding_links":[],"categories":["Java","大数据"],"sub_categories":[],"readme":"# Exchangis\n\n[![License](https://img.shields.io/badge/license-Apache%202-4EB1BA.svg)](https://www.apache.org/licenses/LICENSE-2.0.html)\n\n[English](README.md) | 中文  \n\n## 介绍\n\nExchangis是微众银行大数据平台 WeDataSphere 与社区用户共同研发的的新版数据交换工具，支持异构数据源之间的结构化和非结构化数据传输同步。\n\nExchangis 抽象了一套统一的数据源和同步作业定义插件，允许用户快速接入新的数据源，并只需在数据库中简单配置即可在页面中使用。\n\n基于插件化的框架设计，及计算中间件 [Linkis](https://github.com/apache/incubator-linkis)，Exchangis 可快速集成对接 Linkis 已集成的数据同步引擎，将 Exchangis 的同步作业转换成 Linkis 数据同步引擎的数据同步作业。\n\n借助于 [Linkis](https://github.com/apache/incubator-linkis) 计算中间件的连接、复用与简化能力，Exchangis 天生便具备了高并发、高可用、多租户隔离和资源管控的金融级数据同步能力。\n\n### 界面预览\n\n![image](images/zh_CN/ch1/frontend_view.png)\n\n## 核心特点\n\n### 1. 轻量化的数据源管理  \n\n- 基于 Linkis DataSource，抽象了底层数据源在 Exchangis 作为一个同步作业的 Source 和 Sink 所必须的所有能力。只需简单配置即可完成一个数据源的创建。\n\n- 特别数据源版本发布管理功能，支持历史版本数据源回滚，一键发布无需再次配置历史数据源。\n\n\n### 2.  高稳定，快响应的数据同步任务执行\n\n- **近实时任务管控**  \n快速抓取传输任务日志以及传输速率等信息，对多任务包括CPU使用、内存使用、数据同步记录等各项指标进行监控展示，支持实时关闭任务；  \n\n- **任务高并发传输**  \n多任务并发执行，并且支持复制子任务，实时展示每个任务的状态，多租户执行功能有效避免执行过程中任务彼此影响进行；\n\n- **任务状态自检**  \n监控长时间运行的任务和状态异常任务，中止任务并及时释放占用的资源。  \n\n\n### 3.  与DSS工作流打通，一站式大数据开发的门户\n\n- 实现DSS AppConn包括一级 SSO 规范，二级组织结构规范，三级开发流程规范在内的三级规范；\n- 作为DSS工作流的数据交换节点，是整个工作流链路中的门户流程，为后续的工作流节点运行提供稳固的数据基础；\n\n### 4.  支持多种导数引擎\n\n- 支持Sqoop和DataX引擎进行多种异构数据源之间的导数\n\n## 整体设计\n\n### 架构设计\n\n![架构设计](images/zh_CN/ch1/home_page_zh.png)\n\n\n## 相关文档\n[安装部署文档](docs/zh_CN/ch1/exchangis_deploy_cn.md)  \n[用户手册](docs/zh_CN/ch1/exchangis_user_manual_cn.md)\n\n## 交流贡献\n\n如果您想得到最快的响应，请给我们提 issue，或者扫码进群：\n\n![communication](images/zh_CN/ch1/communication.png)\n\n## License\n\nExchangis is under the Apache 2.0 License. See the [License](./LICENSE) file for details.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FWeBankFinTech%2FExchangis","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FWeBankFinTech%2FExchangis","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FWeBankFinTech%2FExchangis/lists"}