{"id":13526184,"url":"https://github.com/86dbs/dbsyncer","last_synced_at":"2025-04-01T07:31:33.989Z","repository":{"id":63901063,"uuid":"549405802","full_name":"86dbs/dbsyncer","owner":"86dbs","description":"DBSyncer（简称dbs）是一款开源的数据同步中间件，提供MySQL、Oracle、SqlServer、PostgreSQL、Elasticsearch(ES)、Kafka、File、SQL等同步场景。支持上传插件自定义同步转换业务，提供监控全量和增量数据统计图、应用性能预警等。","archived":false,"fork":false,"pushed_at":"2025-04-01T02:20:08.000Z","size":7428,"stargazers_count":503,"open_issues_count":3,"forks_count":89,"subscribers_count":10,"default_branch":"master","last_synced_at":"2025-04-01T03:25:26.553Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":false,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/86dbs.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-10-11T06:19:40.000Z","updated_at":"2025-04-01T02:20:12.000Z","dependencies_parsed_at":"2023-11-25T19:24:20.053Z","dependency_job_id":"22ec83b6-4135-4fe2-8b2d-f04f819a1c6b","html_url":"https://github.com/86dbs/dbsyncer","commit_stats":null,"previous_names":[],"tags_count":34,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/86dbs%2Fdbsyncer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/86dbs%2Fdbsyncer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/86dbs%2Fdbsyncer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/86dbs%2Fdbsyncer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/86dbs","download_url":"https://codeload.github.com/86dbs/dbsyncer/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246600696,"owners_count":20803461,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-01T06:01:26.182Z","updated_at":"2025-04-01T07:31:33.982Z","avatar_url":"https://github.com/86dbs.png","language":"Java","funding_links":[],"categories":["Java","数据管道"],"sub_categories":[],"readme":"## 介绍\n![logo](https://gitee.com/ghi/dbsyncer/raw/master/dbsyncer-web/src/main/resources/static/img/logo.png)\n\n[DBSyncer](https://gitee.com/ghi/dbsyncer)（英[dbsɪŋkɜː(r)]，美[dbsɪŋkɜː(r) 简称dbs）是一款开源的数据同步中间件，提供MySQL、Oracle、SqlServer、PostgreSQL、Elasticsearch(ES)、Kafka、File、SQL等同步场景。支持上传插件自定义同步转换业务，提供监控全量和增量数据统计图、应用性能预警等。\n\n\u003e 特点\n* 组合驱动，自定义库同步到库组合，关系型数据库与非关系型之间组合，任意搭配表同步映射关系\n* 实时监控，驱动全量或增量实时同步运行状态、结果、同步日志和系统日志\n* 开发插件，自定义转化同步逻辑\n\n\u003e 项目地址\n\n* [Gitee](https://gitee.com/ghi/dbsyncer \"https://gitee.com/ghi/dbsyncer\")  \n* [GitHub](https://github.com/86dbs/dbsyncer \"https://github.com/86dbs/dbsyncer\")\n\n[![star](https://gitee.com/ghi/dbsyncer/badge/star.svg?theme=dark)](https://gitee.com/ghi/dbsyncer/stargazers)\n[![fork](https://gitee.com/ghi/dbsyncer/badge/fork.svg?theme=dark)](https://gitee.com/ghi/dbsyncer/members)\n[![license](https://img.shields.io/github/license/mashape/apistatus.svg)](https://gitee.com/ghi/dbsyncer/blob/master/LICENSE)\n\n## 🌈应用场景\n| 连接器        | 数据源 | 目标源 | 支持版本(包含以下) |\n|------------|---|---|-----------------------|\n| MySQL      | ✔ |  ✔ | 5.7.19以上 |\n| Oracle     | ✔ |  ✔ | 10g-19c |\n| SqlServer  | ✔ |  ✔ | 2008以上 |\n| PostgreSQL | ✔ |  ✔ | 9.5.25以上 |\n| ES         | ✔ |  ✔ | 6.0.0-8.15.3 |\n| Kafka      | 开发中 |  ✔ | 2.10-0.9.0.0以上 |\n| File       | ✔ |  ✔ | *.txt, *.unl |\n| SQL        | ✔ |  | 支持以上关系型数据库 |\n| Sqlite     | ✔ |   | |\n| 后期计划       | Redis | | |\n\n## ✨预览\n![连接器和驱动](https://images.gitee.com/uploads/images/2021/0903/003755_01016fc1_376718.png \"驱动管理.png\")\n\n![监控](https://foruda.gitee.com/images/1694424923138969858/111e55e0_376718.png \"监控\")\n\n## 📚[使用手册 Wiki](https://gitee.com/ghi/dbsyncer/wikis \"https://gitee.com/ghi/dbsyncer/wikis\")\n\n## 📦安装配置\n- dbsyncer-x.x.x.zip [社区版安装教程](https://gitee.com/ghi/dbsyncer/wikis/%E6%93%8D%E4%BD%9C%E6%89%8B%E5%86%8C/%E7%A4%BE%E5%8C%BA%E7%89%88%E5%AE%89%E8%A3%85)\n- dbsyncer-enterprise-x.x.x.zip [专业版安装教程](https://gitee.com/ghi/dbsyncer/wikis/%E6%93%8D%E4%BD%9C%E6%89%8B%E5%86%8C/%E4%B8%93%E4%B8%9A%E7%89%88%E5%AE%89%E8%A3%85)\n\n#### 方式一 下载安装包\n1. 安装[JDK 1.8](https://www.oracle.com/java/technologies/jdk8-downloads.html)（省略详细）\n2. 下载安装包[dbsyncer-x.x.x.zip](https://gitee.com/ghi/dbsyncer/releases)（也可手动编译）\n3. 解压安装包，Window执行bin/startup.bat，Linux执行bin/startup.sh\n4. 打开浏览器访问：http://127.0.0.1:18686\n5. 账号和密码：admin/admin\n\n#### 方式二 🐳 docker\n* 阿里云镜像（推荐）\n```shell\ndocker pull registry.cn-hangzhou.aliyuncs.com/xhtb/dbsyncer:latest\ndocker pull registry.cn-hangzhou.aliyuncs.com/xhtb/dbsyncer-enterprise:latest\ndocker pull registry.cn-hangzhou.aliyuncs.com/lifewang/dbsyncer:latest\n```\n* docker镜像\n```shell\ndocker pull crazylife/dbsyncer-web:latest\n```\n* [dockerhub镜像](https://hub.docker.com/repository/docker/crazylife/dbsyncer-web/general)\n\n## ⚙️手动编译\n\u003e 先确保环境已安装JDK和Maven\n```bash\n$ git clone https://gitee.com/ghi/dbsyncer.git\n$ cd dbsyncer\n$ chmod u+x build.sh\n$ ./build.sh\n```\n## 🏆[性能测试](https://gitee.com/ghi/dbsyncer/wikis/%E5%BF%AB%E9%80%9F%E4%BA%86%E8%A7%A3/%E6%80%A7%E8%83%BD%E6%B5%8B%E8%AF%95)\n#### 全量同步\n\n| 系统 | 机器配置 |  数据量 |  耗时 |\n|---|---|---|---|\n| Mac | Apple M3 Pro 12核心 内存18GB | 1亿条 | 31分50秒 |\n| Linux | Intel(R) Xeon(R) CPU E5-2696 v3B 8核心 内存48GB | 1亿条 | 37分52秒 |\n| Windows | AMD Ryzen 7 5800x 8核心 12GB | 1亿条 | 57分43秒 |\n\n#### 增量同步\n| 系统 | 机器配置 |  分配内存 |  TPS | 峰值 |\n|---|---|---|---|---|\n| Mac | Apple M3 Pro 12核心 内存18GB | 4GB | 8112/秒 | 11000/秒 |\n| Linux | Intel(R) Xeon(R) CPU E5-2696 v3B 8核心 内存48GB | 4GB | 8000/秒 | 10000/秒 |\n| Windows | AMD Ryzen 7 5800x 8核心 12GB | 4GB | 7553/秒 | 9000/秒 |\n\n\u003cimg src=\"https://foruda.gitee.com/images/1722860668272963387/7110f00f_376718.png\" /\u003e\n\n\u003cimg src=\"https://foruda.gitee.com/images/1732952268144233045/b607609e_376718.png\" /\u003e\n\n[专业版介绍](https://gitee.com/ghi/dbsyncer/wikis/DBSyncer%E4%B8%93%E4%B8%9A%E7%89%88)\n\n## 🐞[常见问题](https://gitee.com/ghi/dbsyncer/wikis/%E5%92%A8%E8%AF%A2%E9%97%AE%E9%A2%98/%E5%B8%B8%E8%A7%81%E9%97%AE%E9%A2%98) \n* MySQL无法连接。默认使用的驱动版本为8.0.21，如果为mysql5.x需要手动替换驱动 [mysql-connector-java-5.1.40.jar](https://gitee.com/ghi/dbsyncer/attach_files) \n* SQLServer无法连接。案例：[驱动程序无法通过使用安全套接字层(SSL)加密与 SQL Server 建立安全连接。错误:“The server selected protocol version TLS10 is not accepted by client preferences [TLS12]”](https://gitee.com/ghi/dbsyncer/issues/I4PL46?from=project-issue) \n* 同步数据乱码。案例：[mysql8表导入sqlserver2008R2后，sqlserver表nvarchar字段内容为乱码](https://gitee.com/ghi/dbsyncer/issues/I4JXY0) \n* [如何开启远程debug模式？](https://gitee.com/ghi/dbsyncer/issues/I63F6R)  \n\n## 🤝贡献支持\n* DBS团队目标：**坚持开源，让每一个用户都能轻松完成数据同步！** \n* QQ群讨论: **875519623** \n* 欢迎大家提需求和建议[【新建issuses】](https://gitee.com/ghi/dbsyncer/issues/new?issue%5Bassignee_id%5D=0\u0026issue%5Bmilestone_id%5D=0)!（详细描述你的原始需求，我们会帮你提供一些方案，节约大家的成本）\n1) **内推项目** 如您觉得项目不错，可推荐到公司，建立长期稳定的商业合作，提供更专业的技术服务。（入群联系群主）\n2) **参与开发** 项目成员有不同专业的大佬，相信一定能找到您比较感兴趣的方向，欢迎加入团队！（入群联系群主）\n3) 需要专业技术指导，欢迎加 [**会员粉丝服务群**](https://gitee.com/ghi/dbsyncer/wikis/%E4%BC%9A%E5%91%98%E7%B2%89%E4%B8%9D%E6%9C%8D%E5%8A%A1%E7%BE%A4?sort_id=9604090)。\n4) 开源不易，感谢粉丝朋友们的支持！[【捐赠者名单】](https://gitee.com/ghi/dbsyncer/issues/I4HL3C) \n\n\u003cp\u003e\n\u003cimg src=\"https://foruda.gitee.com/images/1736348493470674811/5761f9e8_13999669.png \"二维码_01.png\"\" title=\"微信扫码\" width=\"258px\" height=\"283.8px\" /\u003e\u003cimg src=\"https://foruda.gitee.com/images/1736348568894927308/12fe6e2d_13999669.png \"二维码_02.png\"\" title=\"微信扫码\" width=\"258px\" height=\"283.8px\" /\u003e\u003cimg src=\"https://foruda.gitee.com/images/1738991478241390049/8f566d69_13999669.png \"哔站二维码.png\"\" title=\"微信扫码\" width=\"258px\" height=\"283.8px\" /\u003e\u003cimg src=\"https://foruda.gitee.com/images/1738991647697099987/ebfc3ca3_13999669.png \"抖音二维码.png\"\" title=\"抖音扫码\" width=\"258px\" height=\"283.8px\" /\u003e\u003cimg src=\"https://foruda.gitee.com/images/1710433659737550167/452d76c9_376718.png\" title=\"DBSyncer款项用于研发推广\" width=\"223.2px\" height=\"286.4px\" /\u003e\n\u003cp\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F86dbs%2Fdbsyncer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2F86dbs%2Fdbsyncer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F86dbs%2Fdbsyncer/lists"}