{"id":36416975,"url":"https://github.com/tidb-incubator/tibigdata","last_synced_at":"2026-01-11T17:00:03.520Z","repository":{"id":36978573,"uuid":"270596583","full_name":"tidb-incubator/TiBigData","owner":"tidb-incubator","description":"TiDB connectors for Flink/Hive/Presto","archived":false,"fork":false,"pushed_at":"2024-04-12T07:13:32.000Z","size":3184,"stargazers_count":219,"open_issues_count":29,"forks_count":57,"subscribers_count":15,"default_branch":"master","last_synced_at":"2025-08-02T09:27:29.657Z","etag":null,"topics":["bigdata","cdc","flink","hive","presto","tidb","tikv"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/tidb-incubator.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-06-08T08:51:05.000Z","updated_at":"2025-06-24T07:58:06.000Z","dependencies_parsed_at":"2024-04-12T08:02:06.902Z","dependency_job_id":"9bcf89ff-41a1-4a60-b8cb-f164ec67b2e2","html_url":"https://github.com/tidb-incubator/TiBigData","commit_stats":null,"previous_names":["pingcap-incubator/tibigdata"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/tidb-incubator/TiBigData","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tidb-incubator%2FTiBigData","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tidb-incubator%2FTiBigData/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tidb-incubator%2FTiBigData/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tidb-incubator%2FTiBigData/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/tidb-incubator","download_url":"https://codeload.github.com/tidb-incubator/TiBigData/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tidb-incubator%2FTiBigData/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28314253,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-11T14:58:17.114Z","status":"ssl_error","status_checked_at":"2026-01-11T14:55:53.580Z","response_time":60,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bigdata","cdc","flink","hive","presto","tidb","tikv"],"created_at":"2026-01-11T17:00:02.863Z","updated_at":"2026-01-11T17:00:03.515Z","avatar_url":"https://github.com/tidb-incubator.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# TiBigData\n[License](https://github.com/pingcap-incubator/TiBigData/blob/master/LICENSE)\n\n---\n[![EN doc](https://img.shields.io/badge/document-English-blue.svg)](README.md)\n[![CN doc](https://img.shields.io/badge/文档-中文版-blue.svg)](README_zh_CN.md)\n---\n\nMisc BigData components for TiDB, Presto, Flink and MapReduce connectors for example.\n\n## License\n\nTiBigData project is under the Apache 2.0 license. See the [LICENSE](./LICENSE) file for details.\n\n## Code style\n\nTiBigData use [Google Code Style](https://github.com/google/styleguide).\n\nFormat the code with the following command:\n\n```bash\nmvn com.coveo:fmt-maven-plugin:format\n```\n\n## Getting Started\n\n**Compiling TiBigData requires git and downloading source code directly is not supported.**\n\n[Flink-TiDB-Connector(Batch)](./flink/README.md)\n\n[Flink-TiDB-Connector(Unified Batch \u0026 Streaming)](./flink/README_unified_batch_streaming.md)\n\n[PrestoSQL-TiDB-Connector](./prestosql/README.md)\n\n[Trino-TiDB-Connector](./trino/README.md)\n\n[PrestoDB-TiDB-Connector](./prestodb/README.md)\n\n[MapReduce-TiDB-Connector](./mapreduce/README.md)\n\n[Hive-TiDB-Storage-Handler](./hive/README.md)\n\n## Run Tests\n\nUse the following command to run the integration test.\n\n```bash\nexport TIDB_HOST=\"127.0.0.1\"\nexport TIDB_PORT=\"4000\"\nexport TIDB_USER=\"root\"\nexport TIDB_PASSWORD=\"\"\nmvn clean test-compile failsafe:integration-test -am -pl ${MODULE_NAME}\n```\n\nUse the following command to run the unit test.\n\n```\nmvn clean test -am -pl ${MODULE_NAME}\n```\n\n## Write integration test\n\nFirst, make sure the module add dependency:\n\n```xml\n \u003cdependency\u003e\n      \u003cgroupId\u003eio.tidb\u003c/groupId\u003e\n      \u003cartifactId\u003ebigdata-test\u003c/artifactId\u003e\n      \u003cversion\u003e${project.version}\u003c/version\u003e\n      \u003cscope\u003etest\u003c/scope\u003e\n\u003c/dependency\u003e\n```\n\nSecond, use JUnit Category to clarify integration-test:\n\n```java\nimport io.tidb.bigdata.test.IntegrationTest;\n\n@Category(IntegrationTest.class)\npublic class ConnectorsPluginTest {\n}\n```\n\n## Community\n\nLark / Feishu Group:\n\n\u003cimg src=\"docs/assets/lark_group.png\" width=\"300\"\u003e\n\n## Supported by\n\n### YourKit\n\n![YourKit Logo](https://www.yourkit.com/images/yklogo.png)\n\nYourKit supports open source projects with innovative and intelligent tools\nfor monitoring and profiling Java and .NET applications.\nYourKit is the creator of \u003ca href=\"https://www.yourkit.com/java/profiler/\"\u003eYourKit Java Profiler\u003c/a\u003e,\n\u003ca href=\"https://www.yourkit.com/.net/profiler/\"\u003eYourKit .NET Profiler\u003c/a\u003e,\nand \u003ca href=\"https://www.yourkit.com/youmonitor/\"\u003eYourKit YouMonitor\u003c/a\u003e.\n\n### IntelliJ IDEA\n\n\u003cimg src=\"https://resources.jetbrains.com/storage/products/company/brand/logos/IntelliJ_IDEA_icon.png\" width=\"50\"\u003e\n\n[IntelliJ IDEA](https://www.jetbrains.com/?from=TiBigData) is a Java integrated development environment (IDE) for developing computer software.  \nIt is developed by JetBrains (formerly known as IntelliJ), and is available as an Apache 2 Licensed community edition,  \nand in a proprietary commercial edition. Both can be used for commercial development.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftidb-incubator%2Ftibigdata","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftidb-incubator%2Ftibigdata","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftidb-incubator%2Ftibigdata/lists"}