{"id":21162314,"url":"https://github.com/webankblockchain/data-export","last_synced_at":"2025-07-09T14:32:26.905Z","repository":{"id":38273838,"uuid":"305944174","full_name":"WeBankBlockchain/Data-Export","owner":"WeBankBlockchain","description":"Data-Export支持将链上数据导出到MySQL、ES等便于进行大数据处理的存储介质中，解决区块链数据复杂查询、分析、可视化和处理的问题。","archived":false,"fork":false,"pushed_at":"2024-04-26T07:27:48.000Z","size":1364,"stargazers_count":41,"open_issues_count":3,"forks_count":17,"subscribers_count":5,"default_branch":"master","last_synced_at":"2024-04-26T08:35:40.444Z","etag":null,"topics":["blockchain","consortium","data","data-governance","export","webank-blockchain"],"latest_commit_sha":null,"homepage":"https://data-doc.readthedocs.io/zh_CN/dev/docs/WeBankBlockchain-Data-Export/index.html","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/WeBankBlockchain.png","metadata":{"files":{"readme":"README.md","changelog":"ChangeLog.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2020-10-21T07:34:07.000Z","updated_at":"2024-01-30T06:34:36.000Z","dependencies_parsed_at":"2024-04-26T08:45:22.092Z","dependency_job_id":null,"html_url":"https://github.com/WeBankBlockchain/Data-Export","commit_stats":null,"previous_names":[],"tags_count":10,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WeBankBlockchain%2FData-Export","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WeBankBlockchain%2FData-Export/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WeBankBlockchain%2FData-Export/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WeBankBlockchain%2FData-Export/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/WeBankBlockchain","download_url":"https://codeload.github.com/WeBankBlockchain/Data-Export/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":225563954,"owners_count":17488920,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["blockchain","consortium","data","data-governance","export","webank-blockchain"],"created_at":"2024-11-20T13:24:56.753Z","updated_at":"2024-11-20T13:24:57.239Z","avatar_url":"https://github.com/WeBankBlockchain.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"\n# WeBankBlockchain-Data-Export\n\n[![License](https://img.shields.io/badge/license-Apache%202-4EB1BA.svg)](https://www.apache.org/licenses/LICENSE-2.0.html)\n\n\u003e 穿花度柳飞如箭，\n\u003e 粘絮寻香似落星。\n\u003e 小小微躯能负重，\n\u003e 器器薄翅会乘风。\n\u003e -- 吴承恩\n\n\nWeBankBlockchain-Data-Export 是一个基于[FISCO-BCOS](https://github.com/FISCO-BCOS/FISCO-BCOS)平台的数据导出工具。\n\n数据导出组件WeBankBlockchain-Data-Export的目的在于降低获取区块链数据的开发门槛，提升研发效率。研发人员几乎不需要编写任何代码，只需要进行简单配置，就可以把数据导出到Mysql数据库。\n\nWeBankBlockchain-Data-Export可以导出区块链上的基础数据，如当前块高、交易总量等。如果配置了FISCO-BCOS上运行合约的相关信息，还可导出链上合约的业务数据，包括event、构造函数、合约地址、执行函数的信息等。\n\n**此版本只支持**[FISCO BCOS 2.0](https://fisco-bcos-documentation.readthedocs.io/zh_CN/latest/)及以上版本。\n\n\n## 关键特性\n\n- 支持JSON-RPC、Channel通道、数据仓库源等方式导出数据\n\n- 支持服务和docker方式部署\n\n- 支持多数据源，支持分库分表\n\n- 支持ES存储\n\n- 支持多活部署，多节点自动导出\n\n- 支持自定义导出数据内容\n\n- 提供SDK的集成方式\n\n- 支持可视化的监控页面\n\n\n## 环境要求\n\n在使用本组件前，请确认系统环境已安装相关依赖软件，清单如下：\n\n| 依赖软件 | 说明 |备注|\n| --- | --- | --- |\n| FISCO-BCOS | \u003e= 2.0， 1.x版本请参考V0.5版本 dev分支 |\n| Bash | 需支持Bash（理论上来说支持所有ksh、zsh等其他unix shell，但未测试）|\n| Java | JDK[1.8] ||\n| Git | 下载的安装包使用Git | |\n| MySQL | \u003e= mysql-community-server[5.7] | 理论上来说支持主流数据库，但未测试|\n| zookeeper | \u003e= zookeeper[3.4] | 只有在进行集群部署的时候需要安装|\n| docker    | \u003e= docker[18.0.0] | 只有需要可视化监控页面的时候才需要安装|\n| ElasticSearch | \u003e= elasticsearch [7.0] | 只有在需要ES存储时安装 |\n\n\n## 文档\n- [**中文**](https://data-doc.readthedocs.io/zh_CN/latest/docs/WeBankBlockchain-Data-Export/index.html)\n- [**快速安装**](https://data-doc.readthedocs.io/zh_CN/latest/docs/WeBankBlockchain-Data-Export/install.html)\n\n\n## 贡献代码\n欢迎参与本项目的社区建设：\n- 如项目对您有帮助，欢迎点亮我们的小星星(点击项目右上方Star按钮)。\n- 欢迎提交代码(Pull requests)。\n- [提问和提交BUG](https://github.com/WeBankBlockchain/WeBankBlockchain-Data-Export/issues)。\n- 如果发现代码存在安全漏洞，请在[这里](https://security.webank.com)上报。\n\n\n## License\n![license](http://img.shields.io/badge/license-Apache%20v2-blue.svg)\n\n开源协议为[Apache License 2.0](http://www.apache.org/licenses/). 详情参考[LICENSE](../LICENSE)。\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwebankblockchain%2Fdata-export","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fwebankblockchain%2Fdata-export","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwebankblockchain%2Fdata-export/lists"}