{"id":26032119,"url":"https://github.com/apache/seatunnel-datasource-sdk","last_synced_at":"2025-04-09T21:09:38.319Z","repository":{"id":65979449,"uuid":"579823098","full_name":"apache/seatunnel-datasource-sdk","owner":"apache","description":"SeaTunnel is a distributed, high-performance data integration platform for the synchronization and transformation of massive data (offline \u0026 real-time).","archived":false,"fork":false,"pushed_at":"2023-06-14T22:55:55.000Z","size":56,"stargazers_count":5,"open_issues_count":1,"forks_count":4,"subscribers_count":15,"default_branch":"main","last_synced_at":"2025-04-03T04:17:05.954Z","etag":null,"topics":["apache","data-integration","data-pipeline","etl-framework","high-performance","offline","real-time","seatunnel","sql-engine"],"latest_commit_sha":null,"homepage":"https://seatunnel.apache.org/","language":"Java","has_issues":false,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/apache.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2022-12-19T02:32:12.000Z","updated_at":"2024-11-26T13:11:26.000Z","dependencies_parsed_at":"2024-01-23T20:49:21.316Z","dependency_job_id":"1d7174ae-2036-4138-b041-3bd162c2b4bf","html_url":"https://github.com/apache/seatunnel-datasource-sdk","commit_stats":null,"previous_names":["apache/seatunnel-datasource-sdk"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fseatunnel-datasource-sdk","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fseatunnel-datasource-sdk/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fseatunnel-datasource-sdk/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fseatunnel-datasource-sdk/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/apache","download_url":"https://codeload.github.com/apache/seatunnel-datasource-sdk/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247715196,"owners_count":20984012,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["apache","data-integration","data-pipeline","etl-framework","high-performance","offline","real-time","seatunnel","sql-engine"],"created_at":"2025-03-06T21:04:40.179Z","updated_at":"2025-04-09T21:09:38.292Z","avatar_url":"https://github.com/apache.png","language":"Java","readme":"# Apache SeaTunnel (Incubating)\n\n\u003cimg src=\"https://seatunnel.apache.org/image/logo.png\" alt=\"seatunnel logo\" height=\"200px\" align=\"right\" /\u003e\n\n[![Backend Workflow](https://github.com/apache/incubator-seatunnel/actions/workflows/backend.yml/badge.svg?branch=dev)](https://github.com/apache/incubator-seatunnel/actions/workflows/backend.yml)\n[![Slack](https://img.shields.io/badge/slack-%23seatunnel-4f8eba?logo=slack)](https://join.slack.com/t/apacheseatunnel/shared_invite/zt-123jmewxe-RjB_DW3M3gV~xL91pZ0oVQ)\n[![Twitter Follow](https://img.shields.io/twitter/follow/ASFSeaTunnel.svg?label=Follow\u0026logo=twitter)](https://twitter.com/ASFSeaTunnel)\n\n---\n[![EN doc](https://img.shields.io/badge/document-English-blue.svg)](README.md)\n\nSeaTunnel was formerly named Waterdrop , and renamed SeaTunnel since October 12, 2021.\n\n---\n\nSeaTunnel is a very easy-to-use ultra-high-performance distributed data integration platform that supports real-time\nsynchronization of massive data. It can synchronize tens of billions of data stably and efficiently every day, and has\nbeen used in the production of nearly 100 companies.\n\n## Apache SeaTunnel (Incubating) DataSourceSdk\ntodo\n## Downloads\n\nDownload address for run-directly software package : https://seatunnel.apache.org/download\n\n## Quick start\n\n**SeaTunnel Engine**\nhttps://seatunnel.apache.org/docs/start-v2/locally/quick-start-seatunnel-engine/\n\n**Spark**\nhttps://seatunnel.apache.org/docs/start-v2/locally/quick-start-spark\n\n**Flink**\nhttps://seatunnel.apache.org/docs/start-v2/locally/quick-start-flink\n\n## Application practice cases\n\n- Weibo, Value-added Business Department Data Platform\n\nWeibo business uses an internal customized version of SeaTunnel and its sub-project Guardian for SeaTunnel On Yarn task\nmonitoring for hundreds of real-time streaming computing tasks.\n\n- Sina, Big Data Operation Analysis Platform\n\nSina Data Operation Analysis Platform uses SeaTunnel to perform real-time and offline analysis of data operation and\nmaintenance for Sina News, CDN and other services, and write it into Clickhouse.\n\n- Sogou, Sogou Qiqian System\n\nSogou Qiqian System takes SeaTunnel as an ETL tool to help establish a real-time data warehouse system.\n\n- Qutoutiao, Qutoutiao Data Center\n\nQutoutiao Data Center uses SeaTunnel to support mysql to hive offline ETL tasks, real-time hive to clickhouse backfill\ntechnical support, and well covers most offline and real-time tasks needs.\n\n- Yixia Technology, Yizhibo Data Platform\n\n- Yonghui Superstores Founders' Alliance-Yonghui Yunchuang Technology, Member E-commerce Data Analysis Platform\n\nSeaTunnel provides real-time streaming and offline SQL computing of e-commerce user behavior data for Yonghui Life, a\nnew retail brand of Yonghui Yunchuang Technology.\n\n- Shuidichou, Data Platform\n\nShuidichou adopts SeaTunnel to do real-time streaming and regular offline batch processing on Yarn, processing 3~4T data\nvolume average daily, and later writing the data to Clickhouse.\n\n- Tencent Cloud\n\nCollecting various logs from business services into Apache Kafka, some of the data in Apache Kafka is consumed and extracted through Seatunnel, and then store into Clickhouse.\n\nFor more use cases, please refer to: https://seatunnel.apache.org/blog\n\n## Code of conduct\n\nThis project adheres to the Contributor Covenant [code of conduct](https://www.apache.org/foundation/policies/conduct).\nBy participating, you are expected to uphold this code. Please follow\nthe [REPORTING GUIDELINES](https://www.apache.org/foundation/policies/conduct#reporting-guidelines) to report\nunacceptable behavior.\n\n## Developer\n\nThanks to [all developers](https://github.com/apache/incubator-seatunnel/graphs/contributors)!\n\n\u003ca href=\"https://github.com/apache/incubator-seatunnel/graphs/contributors\"\u003e\n  \u003cimg src=\"https://contrib.rocks/image?repo=apache/incubator-seatunnel\" /\u003e\n\u003c/a\u003e\n\n## Contact Us\n\n* Mail list: **dev@seatunnel.apache.org**. Mail to `dev-subscribe@seatunnel.apache.org`, follow the reply to subscribe\n  the mail list.\n* Slack: https://join.slack.com/t/apacheseatunnel/shared_invite/zt-123jmewxe-RjB_DW3M3gV~xL91pZ0oVQ\n* Twitter: https://twitter.com/ASFSeaTunnel\n* [Bilibili](https://space.bilibili.com/1542095008) (for Chinese users)\n\n## Landscapes\n\n\u003cp align=\"center\"\u003e\n\u003cbr/\u003e\u003cbr/\u003e\n\u003cimg src=\"https://landscape.cncf.io/images/left-logo.svg\" width=\"150\" alt=\"\"/\u003e\u0026nbsp;\u0026nbsp;\u003cimg src=\"https://landscape.cncf.io/images/right-logo.svg\" width=\"200\" alt=\"\"/\u003e\n\u003cbr/\u003e\u003cbr/\u003e\nSeaTunnel enriches the \u003ca href=\"https://landscape.cncf.io/?landscape=observability-and-analysis\u0026license=apache-license-2-0\"\u003eCNCF CLOUD NATIVE Landscape.\u003c/a \u003e\n\n\u003c/p \u003e\n\n## Our Users\nVarious companies and organizations use SeaTunnel for research, production and commercial products.\nVisit our [website](https://seatunnel.apache.org/user) to find the user page.\n\n## License\n[Apache 2.0 License.](LICENSE)\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapache%2Fseatunnel-datasource-sdk","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fapache%2Fseatunnel-datasource-sdk","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapache%2Fseatunnel-datasource-sdk/lists"}