https://github.com/analysys/EasyScheduler
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
https://github.com/analysys/EasyScheduler
airflow azkaban cloud-native data-pipelines job-scheduler orchestration powerful-data-pipelines task-scheduler workflow workflow-orchestration workflow-schedule
Last synced: 4 months ago
JSON representation
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
- Host: GitHub
- URL: https://github.com/analysys/EasyScheduler
- Owner: apache
- License: apache-2.0
- Created: 2019-03-01T16:39:25.000Z (over 6 years ago)
- Default Branch: dev
- Last Pushed: 2024-10-25T07:29:57.000Z (8 months ago)
- Last Synced: 2024-10-29T16:58:10.434Z (8 months ago)
- Topics: airflow, azkaban, cloud-native, data-pipelines, job-scheduler, orchestration, powerful-data-pipelines, task-scheduler, workflow, workflow-orchestration, workflow-schedule
- Language: Java
- Homepage: https://dolphinscheduler.apache.org/
- Size: 231 MB
- Stars: 12,813
- Watchers: 327
- Forks: 4,605
- Open Issues: 270
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Codeowners: .github/CODEOWNERS
Awesome Lists containing this project
- awesome-java - EasyScheduler - to-expand visual DAG workflow scheduling system, dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing. (Software/System / Develop)
README
# Apache Dolphinscheduler
[](https://www.apache.org/licenses/LICENSE-2.0.html)
[](https://sonarcloud.io/dashboard?id=apache-dolphinscheduler)
[](https://twitter.com/dolphinschedule)
[](https://s.apache.org/dolphinscheduler-slack)
[](README_zh_CN.md)
## About
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code. It is also provided powerful user interface,
dedicated to solving complex task dependencies in the data pipeline and providing various types of jobs available **out of the box**
The key features for DolphinScheduler are as follows:
- Easy to deploy, provide four ways to deploy which including Standalone, Cluster, Docker and Kubernetes.
- Easy to use, workflow can be created and managed by four ways, which including Web UI, [Python SDK](https://dolphinscheduler.apache.org/python/main/index.html) and Open API
- Highly reliable and high availability, decentralized architecture with multi-master and multi-worker, native supports horizontal scaling.
- High performance, its performance is N times faster than other orchestration platform and it can support tens of millions of tasks per day
- Cloud Native, DolphinScheduler supports orchestrating multi-cloud/data center workflow, and supports custom task type
- Versioning both workflow and workflow instance(including tasks)
- Various state control of workflow and task, support pause/stop/recover them in any time
- Multi-tenancy support
- Others like backfill support(Web UI native), permission control including project and data source
## QuickStart
- For quick experience
- Want to [start with standalone](https://dolphinscheduler.apache.org/en-us/docs/3.1.5/guide/installation/standalone)
- Want to [start with Docker](https://dolphinscheduler.apache.org/en-us/docs/3.1.5/guide/start/docker)
- For Kubernetes
- [Start with Kubernetes](https://dolphinscheduler.apache.org/en-us/docs/3.1.5/guide/installation/kubernetes)
- For Terraform
- [Start with Terraform](deploy/terraform/README.md)
## User Interface Screenshots
* **Homepage:** Project and workflow overview, including the latest workflow instance and task instance status statistics.
* **Workflow Definition:** Create and manage workflow by drag and drop, easy to build and maintain complex workflow, support [bulk of tasks](https://dolphinscheduler.apache.org/en-us/docs/3.1.5/introduction-to-functions_menu/task_menu) out of box.
* **Workflow Tree View:** Abstract tree structure could clearer understanding of the relationship between tasks
* **Data source:** Manage support multiple external data sources, provide unified data access capabilities for such as MySQL, PostgreSQL, Hive, Trino, etc.
* **Monitor:** View the status of the master, worker and database in real time, including server resource usage and load, do quick health check without logging in to the server.
## Suggestions & Bug Reports
Follow [this guide](https://github.com/apache/dolphinscheduler/issues/new/choose) to report your suggestions or bugs.
## Contributing
The community welcomes everyone to contribute, please refer to this page to find out more: [How to contribute](docs/docs/en/contribute/join/contribute.md),
find the good first issue in [here](https://github.com/apache/dolphinscheduler/contribute) if you are new to DolphinScheduler.
## Community
Welcome to join the Apache DolphinScheduler community by:
- Join the [DolphinScheduler Slack](https://s.apache.org/dolphinscheduler-slack) to keep in touch with the community
- Follow the [DolphinScheduler Twitter](https://twitter.com/dolphinschedule) and get the latest news
- Subscribe DolphinScheduler mail list, [[email protected]](mailto:[email protected]) for user and [[email protected]](mailto:[email protected]) for developer
# Landscapes
DolphinScheduler enriches the CNCF CLOUD NATIVE Landscape.