{"id":13415179,"url":"https://github.com/apache/seatunnel","last_synced_at":"2025-05-12T05:23:45.700Z","repository":{"id":36950156,"uuid":"99412308","full_name":"apache/seatunnel","owner":"apache","description":"SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.","archived":false,"fork":false,"pushed_at":"2025-05-12T01:54:17.000Z","size":44453,"stargazers_count":8478,"open_issues_count":794,"forks_count":1966,"subscribers_count":173,"default_branch":"dev","last_synced_at":"2025-05-12T02:40:08.794Z","etag":null,"topics":["apache","batch","cdc","change-data-capture","data-ingestion","data-integration","elt","high-performance","offline","real-time","streaming"],"latest_commit_sha":null,"homepage":"https://seatunnel.apache.org/","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/apache.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-08-05T09:14:47.000Z","updated_at":"2025-05-12T01:54:21.000Z","dependencies_parsed_at":"2024-01-17T15:10:10.869Z","dependency_job_id":"d02ff2c6-a2ac-4018-b869-c9036e8104d3","html_url":"https://github.com/apache/seatunnel","commit_stats":{"total_commits":3814,"total_committers":318,"mean_commits":11.9937106918239,"dds":0.891976927110645,"last_synced_commit":"d886495584c48392c2c09d2fb5d3d1780fc33244"},"previous_names":["apache/incubator-seatunnel","interestinglab/waterdrop"],"tags_count":53,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fseatunnel","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fseatunnel/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fseatunnel/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fseatunnel/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/apache","download_url":"https://codeload.github.com/apache/seatunnel/tar.gz/refs/heads/dev","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":253672698,"owners_count":21945480,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["apache","batch","cdc","change-data-capture","data-ingestion","data-integration","elt","high-performance","offline","real-time","streaming"],"created_at":"2024-07-30T21:00:44.603Z","updated_at":"2025-05-12T05:23:45.674Z","avatar_url":"https://github.com/apache.png","language":"Java","readme":"# Apache SeaTunnel\n\n\u003cimg src=\"https://seatunnel.apache.org/image/logo.png\" alt=\"SeaTunnel Logo\" height=\"200px\" align=\"right\" /\u003e\n\n[![Build Workflow](https://github.com/apache/seatunnel/actions/workflows/build_main.yml/badge.svg?branch=dev)](https://github.com/apache/seatunnel/actions/workflows/build_main.yml)\n[![Join Slack](https://img.shields.io/badge/slack-%23seatunnel-4f8eba?logo=slack)](https://s.apache.org/seatunnel-slack)\n[![Twitter Follow](https://img.shields.io/twitter/follow/ASFSeaTunnel.svg?label=Follow\u0026logo=twitter)](https://twitter.com/ASFSeaTunnel)\n\n## Table of Contents\n- [Overview](#overview)\n- [Why Choose SeaTunnel](#why-choose-seatunnel)\n- [Key Features](#key-features)\n- [SeaTunnel Workflow](#seatunnel-workflow)\n- [Supported Connectors](#supported-connectors)\n- [Getting Started](#getting-started)\n- [Use Cases](#use-cases)\n- [Code of Conduct](#code-of-conduct)\n- [Contributors](#contributors)\n- [How to Compile](#how-to-compile)\n- [Contact Us](#contact-us)\n- [Landscapes](#landscapes)\n- [Apache SeaTunnel Web Project](#apache-seaTunnel-web-project)\n- [Our Users](#our-users)\n- [License](#license)\n- [Frequently Asked Questions](#frequently-asked-questions)\n\n## Overview\n\nSeaTunnel is a next-generation, high-performance, distributed data integration tool, capable of synchronizing vast amounts of data daily. It's trusted by numerous companies for its efficiency and stability.\n\n\n## Why Choose SeaTunnel\n\nSeaTunnel addresses common data integration challenges:\n\n- **Diverse Data Sources**: Seamlessly integrates with hundreds of evolving data sources.\n  \n- **Complex Synchronization Scenarios**: Supports various synchronization methods, including real-time, CDC, and full database synchronization.\n  \n- **Resource Efficiency**: Minimizes computing resources and JDBC connections for real-time synchronization.\n  \n- **Quality and Monitoring**: Provides data quality and monitoring to prevent data loss or duplication.\n\n## Key Features\n\n- **Diverse Connectors**: Offers support for over 100 connectors, with ongoing expansion.\n  \n- **Batch-Stream Integration**: Easily adaptable connectors simplify data integration management.\n  \n- **Distributed Snapshot Algorithm**: Ensures data consistency across synchronized data.\n  \n- **Multi-Engine Support**: Works with SeaTunnel Zeta Engine, Flink, and Spark.\n  \n- **JDBC Multiplexing and Log Parsing**: Efficiently synchronizes multi-tables and databases.\n  \n- **High Throughput and Low Latency**: Provides high-throughput data synchronization with low latency.\n  \n- **Real-Time Monitoring**: Offers detailed insights during synchronization.\n  \n- **Two Job Development Methods**: Supports coding and visual job management with the [SeaTunnel Web Project](https://github.com/apache/seatunnel-web).\n\n## SeaTunnel Workflow\n\n![SeaTunnel Workflow](docs/images/architecture_diagram.png)\n\nConfigure jobs, select execution engines, and parallelize data using Source Connectors. Easily develop and extend connectors to meet your needs.\n\n## Supported Connectors\n\n- [Source Connectors](https://seatunnel.apache.org/docs/connector-v2/source)\n- [Sink Connectors](https://seatunnel.apache.org/docs/connector-v2/sink)\n- [Transform Connectors](docs/en/transform-v2)\n\n## Getting Started\n\nDownload SeaTunnel from the [Official Website](https://seatunnel.apache.org/download).\n\nChoose your runtime execution engine:\n- [SeaTunnel Zeta Engine](https://seatunnel.apache.org/docs/start-v2/locally/quick-start-seatunnel-engine/)\n- [Spark](https://seatunnel.apache.org/docs/start-v2/locally/quick-start-spark)\n- [Flink](https://seatunnel.apache.org/docs/start-v2/locally/quick-start-flink)\n\n## Use Cases\n\nExplore real-world use cases of SeaTunnel, such as Weibo, Tencent Cloud, Sina, Sogou, and Yonghui Superstores. More use cases can be found on the [SeaTunnel Blog](https://seatunnel.apache.org/blog).\n\n## Code of Conduct\n\nParticipate in this project in accordance with the Contributor Covenant [Code of Conduct](https://www.apache.org/foundation/policies/conduct).\n\n## Contributors\n\nWe appreciate all developers for their contributions. See the [List Of Contributors](https://github.com/apache/seatunnel/graphs/contributors).\n\n## How to Compile\n\nRefer to this [Setup](docs/en/contribution/setup.md) for compilation instructions.\n\n## Contact Us\n\n- Mail list: **dev@seatunnel.apache.org**. Subscribe by sending an email to `dev-subscribe@seatunnel.apache.org`.\n\n- Slack: [Join SeaTunnel Slack](https://s.apache.org/seatunnel-slack)\n\n- Twitter: [ASFSeaTunnel on Twitter](https://twitter.com/ASFSeaTunnel)\n\n## Landscapes\n\nSeaTunnel enriches the [CNCF CLOUD NATIVE Landscape](https://landscape.cncf.io/?landscape=observability-and-analysis\u0026license=apache-license-2-0).\n\n## Apache SeaTunnel Web Project\n\nSeaTunnel Web is a web project that provides visual management of jobs, scheduling, running and monitoring capabilities. It is developed based on the SeaTunnel Connector API and the SeaTunnel Zeta Engine. It is a web project that can be deployed independently. It is also a sub-project of SeaTunnel.\nFor more information, please refer to [SeaTunnel Web](https://github.com/apache/seatunnel-web)\n\n## Our Users\n\nCompanies and organizations worldwide use SeaTunnel for research, production, and commercial products. Visit our [Users](https://seatunnel.apache.org/user) for more information.\n\n## License\n\n[Apache 2.0 License](LICENSE)\n\n## Frequently Asked Questions\n\n### 1. How do I install SeaTunnel?\n\nFollow the [Installation Guide](https://seatunnel.apache.org/docs/start-v2/locally/deployment/) on our website to get\nstarted.\n\n### 2. How can I contribute to SeaTunnel?\n\nWe welcome contributions! Please refer to our [Contribution Guidelines](https://github.com/apache/seatunnel/blob/dev/docs/en/contribution/coding-guide.md) for details.\n\n### 3. How do I report issues or request features?\n\nYou can report issues or request features on our [GitHub Repository](https://github.com/apache/seatunnel/issues).\n\n### 4. Can I use SeaTunnel for commercial purposes?\n\nYes, SeaTunnel is available under the Apache 2.0 License, allowing commercial use.\n\n### 5. Where can I find documentation and tutorials?\n\nOur [Official Documentation](https://seatunnel.apache.org/docs) includes detailed guides and tutorials to help you get started.\n\n### 6. Is there a community or support channel?\n\nJoin our Slack community for support and discussions: [SeaTunnel Slack](https://s.apache.org/seatunnel-slack).\nMore information, please refer to [FAQ](https://seatunnel.apache.org/docs/faq). \n","funding_links":[],"categories":["Java","其他__大数据","streaming","大数据","新项目脚手架"],"sub_categories":["网络服务_其他"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapache%2Fseatunnel","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fapache%2Fseatunnel","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapache%2Fseatunnel/lists"}