{"id":21439008,"url":"https://github.com/datasphere-oss/datasphere-integration","last_synced_at":"2025-07-14T15:32:57.329Z","repository":{"id":48051406,"uuid":"210347616","full_name":"datasphere-oss/datasphere-integration","owner":"datasphere-oss","description":"an data-centric integration platform ","archived":false,"fork":false,"pushed_at":"2021-08-09T20:55:56.000Z","size":21727,"stargazers_count":48,"open_issues_count":11,"forks_count":17,"subscribers_count":7,"default_branch":"master","last_synced_at":"2025-04-08T10:54:09.273Z","etag":null,"topics":["data-bus","data-integration","data-interchange","data-sharing","elt","esb","etl","kettle","realtime-messaging"],"latest_commit_sha":null,"homepage":null,"language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/datasphere-oss.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-09-23T12:18:07.000Z","updated_at":"2024-09-22T15:43:00.000Z","dependencies_parsed_at":"2022-08-12T17:31:07.869Z","dependency_job_id":null,"html_url":"https://github.com/datasphere-oss/datasphere-integration","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/datasphere-oss/datasphere-integration","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datasphere-oss%2Fdatasphere-integration","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datasphere-oss%2Fdatasphere-integration/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datasphere-oss%2Fdatasphere-integration/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datasphere-oss%2Fdatasphere-integration/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/datasphere-oss","download_url":"https://codeload.github.com/datasphere-oss/datasphere-integration/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datasphere-oss%2Fdatasphere-integration/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265311990,"owners_count":23745177,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-bus","data-integration","data-interchange","data-sharing","elt","esb","etl","kettle","realtime-messaging"],"created_at":"2024-11-23T00:38:50.314Z","updated_at":"2025-07-14T15:32:54.820Z","avatar_url":"https://github.com/datasphere-oss.png","language":"Java","readme":"# datasphere-integration 数据集成平台介绍\n----------------------------------------------\nDataSphere 数据集成平台是集数据采集、数据接入、数据交换、数据同步、数据总线于一体的大数据集成平台，让传统IT架构迅速迈入数据智能时代。DataSphere 是基于分布式数据网格的云原生架构，具有高可扩展性和高可靠性，可在上百台集群规模上弹性伸缩。DataSphere 数据集成平台支持几乎所有主流数据源，可适配各种结构化、半结构化、非结构化的外部数据源，具有超高速的数据集成能力。\n\n## DataSphere功能介绍\n----------------------------------------------\n* 实现关系型数据库、消息总线、系统接口、文件系统、大数据平台等。\n* 实现跨系统、跨平台、跨网域之间的数据混合连接、互联互通。\n* 可在SQL数据库、NoSQL数据库和Hadoop大数据平台之间实时流转数据。\n* 分布式集群部署，扩展性高，处理速度快，适合于实时交换共享场景。\n* 可数据容错，平台故障后，可保持数据完整性和一致性。\n* 开发部署成本低，拖拉拽构建实时应用，管理简便。\n\n\n\n## DataSphere功能亮点\n----------------------------------------------\n* 完全基于大数据技术：可大规模分布式集群部署。\n* 支持几乎所有数据源：关系型数据库，各类文件，大数据平台，物联网数据。\n* 数据吞吐量高：支持不少于100TB/天的数据采集交换能力 。\n* 高并发并行处理：单集群支持5000个以上的高并发数据交换任务。\n* 共享交换速度快：单任务每秒完成至少20万条业务数据的实时采集能力。\n* 兼容开放性：可部署在主流的操作系统之上，开发平台API 供外部系统调用。\n* 云服务部署：可部署在云环境，以自服务的方式为数据共享交换的用户提供服务。\n\n## 架构原理\n----------------------------------------------\n请阅读 [架构原理](https://github.com/datasphere-oss/datasphere-integration/blob/master/docs/architecture.md) 文档\n\n## 快速入门\n----------------------------------------------\n请阅读  [快速入门](https://github.com/datasphere-oss/datasphere-integration/blob/master/QUICKSTART.md) 文档\n\n\n## 数据源列表\n----------------------------------------------\n\nDataSphere 社区版支持如下数据源, 对各种数据源支持会不定期持续更新...\n\n### 数据源表格如下：\n -----------------------------------------------\n| 数据端名称  | 数据源端 | 数据目标端  | 开源  |\n|-------------|:------:|-----------|----------:|\n| Oracle      |   √    |     √     |    √      |\n| MSSQL       |   √    |     √     |    √      |\n| PostgreSQL  |   √    |     √     |    √      |\n| TiDB        |   √    |     √     |    √      |\n| Hashdata    |   √    |     √     |    √      |\n| Greenplum   |   √    |     √     |    √      |\n| Clickhouse  |   √    |     √     |    √      |\n| Apache Hive |   √    |     √     |    √      |\n| Apache HAWQ |   √    |     √     |    √      |\n| Apache HBase|   √    |     √     |    √      |\n| Apache HDFS |   √    |     √     |    √      |\n| Apache Kafka|   √    |     √     |    √      |\n| Apache Spark|   √    |     √     |    √      |\n| Apache Flink|   √    |     √     |    √      |\n| MQTT        |   √    |     √     |    √      |\n| JMS         |   √    |     √     |    √      |\n| Weblogic    |   √    |     √     |    √      |\n| WebSphere   |   √    |     √     |    √      |\n| ...\n\n\n\n\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdatasphere-oss%2Fdatasphere-integration","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdatasphere-oss%2Fdatasphere-integration","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdatasphere-oss%2Fdatasphere-integration/lists"}