Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

awesome-workflow-engines

A curated list of awesome open source workflow engines
https://github.com/meirwah/awesome-workflow-engines

Last synced: about 13 hours ago
JSON representation

  • Full fledged product

    • Airflow - airflow.svg)](https://github.com/apache/incubator-airflow) - Python-based platform for running directed acyclic graphs (DAGs) of tasks
    • Azkaban - Batch workflow job scheduler created at LinkedIn to run Hadoop jobs.
    • CabloyJS - A Node.js full-stack framework with workflow engine, based on koa + egg + vue + framework7.
    • CloudSlang - slang.svg)](https://github.com/CloudSlang/cloud-slang) - Workflow engine to automate your DevOps use cases.
    • Covalent - Workflow orchestration platform for quantum and high performance computing.
    • Cylc - flow.svg)](https://github.com/cylc/cylc-flow) - Workflow engine that orchestrates complex distributed workflows with cyclic or acyclic graphs. It was originally designed to automate weather forecasting systems at NIWA.
    • Dagu - A No-code workflow executor. It executes workflows from declarative YAML definitions.
    • Dagster - io/dagster.svg)](https://github.com/dagster-io/dagster) - Data orchestrator for machine learning, analytics, and ETL.
    • DigDag - data/digdag.svg)](https://github.com/treasure-data/digdag) - Digdag is a simple tool that helps you to build, run, schedule, and monitor complex pipelines of tasks.
    • Flyte - A container-native, type-safe workflow and pipelines platform optimized for large scale processing and machine learning written in Golang. Workflows can be written in any language, with out of the box support for Python.
    • ForML - A development framework and MLOps platform for the lifecycle management of data science projects.
    • Imixs-Workflow - workflow.svg)](https://github.com/imixs/imixs-workflow) - A powerful human-centric Workflow Engine based on the BPMN 2.0 standard.
    • Kestra - io/kestra.svg)](https://github.com/kestra-io/kestra) - Open source data orchestration and scheduling platform with declarative syntax.
    • Kiba - Data processing & ETL framework for Ruby
    • Laravel Workflow - workflow/laravel-workflow.svg)](https://github.com/laravel-workflow/laravel-workflow) - Laravel Workflow is a durable workflow engine that allows users to track job status, orchestrate microservices and write long running persistent distributed workflows in PHP powered by Laravel Queues.
    • Martian - lang/martian.svg)](https://github.com/martian-lang/martian) - An elegant, powerful language and framework for building high-performance computational pipelines.
    • Metaflow - Metaflow is a human-friendly Python/R library that helps scientists and engineers build and manage real-life data science projects.
    • MassTransit - .Net Messaging system with Saga Workflow Support
    • Mistral - Workflow service, in OpenStack foundation.
    • N8n-io - io/n8n.svg)](https://github.com/n8n-io/n8n) - Free and open node based Workflow Automation Tool. Easily automate tasks across different services.
    • Nextflow - io/nextflow.svg)](https://github.com/nextflow-io/nextflow) - Develop container-backed, reproducible workflows portable across computational platforms including local, HPC schedulers, AWS Batch, Google Genomics Pipelines, and Kubernetes.
    • Node-RED - red/node-red.svg)](https://github.com/node-red/node-red) - Node-RED is a NodeJS based workflow tool featuring a browser based editor for wiring together hardware devices, APIs and online services in new and interesting ways.
    • Oozie - Workflow Scheduler for Hadoop.
    • Parsl - Python framework for workflow orchestration and parallelization based on a dynamic graph of tasks and their data dependencies.
    • Pegasus - isi/pegasus.svg)](https://github.com/pegasus-isi/pegasus) - Automate, recover, and debug scientific computations.
    • Platformeco - Technology platform, allows Product & Project teams easily build micro services using drag & drop UI and operate it, within out of the box cloud and CI/CD tools with deep tracing & monitoring.
    • Plynx - team/plynx.svg)](https://github.com/plynx-team/plynx) - Interactive platform with drag and drop interface for building and deploying portable and scalable end-to-end data driven workflows.
    • RunDeck - Job Scheduler and Runbook Automation.
    • Snakemake - Workflow management system to create reproducible and scalable data analyses; python-based inspired by GNU `Make`.
    • StackStorm - Robust Automation Engine providing Sensors, Triggers, Rules, Workflows, and Actions. StackStorm is how you "glue" your applications together.
    • Temporal - Temporal is a microservice orchestration platform which enables developers to build scalable applications without sacrificing productivity or reliability. Temporal is a mature technology, a fork of Uber's Cadence. Temporal is being developed by Temporal Technologies, a startup by the creators of Cadence.
    • Titanoboa - Titanoboa is a platform for creating complex workflows on JVM.
    • Wexflow
    • Windmill - labs/windmill.svg)](https://github.com/windmill-labs/windmill) - Turn scripts into workflows and UIs. Open-source alternative to Airplane and Retool.
    • Workflow Engine - A lightweight .NET and Java workflow engine.
    • YAWL - (Yet Another Workflow Language), Java-based, handles complex data transformations, and full integration with organizational resources and external Web Services.
    • Zeebe - io/zeebe.svg)](https://github.com/zeebe-io/zeebe) - A horizontally scalable, cloud-native workflow engine that executes BPMN models and is best operated on Kubernetes; polyglot clients connect via gRPC or available language clients.
    • Activepieces - Open source no-code business automation, alternative to Zapier
    • AiiDA - core.svg)](https://github.com/aiidateam/aiida-core) - Open source workflow manager for computational science with strong focus on performance, provenance, and extensibility.
    • Argo Workflows - workflows.svg)](https://github.com/argoproj/argo-workflows) - Open source container-native workflow engine for getting work done on Kubernetes
    • Arvados - Open Source data and workflow management platform with emphasis on reproducibily, scale, and secure data sharing, deployable on cloud and HPC.
    • Cadence - An orchestration engine to execute asynchronous long-running business logic developed by Uber Engineering.
    • CDS - Enterprise-grade continuous delivery & DevOps automation open source platform developped by OVHcloud.
    • CGraph - A simple-used and cross-platform DAG framework based on C++17 without any 3rd-party.
    • Conductor - oss/conductor.svg)](https://github.com/conductor-oss/conductor) - Conductor is a microservices orchestration platform that enables developers to build scalable, durable application flows. Conductor workflows are language and framework-agnostic. The Conductor is maintained by Orkes and a team of open-source contributors.
    • Copper - engine/copper-engine.svg)](https://github.com/copper-engine/copper-engine) - A high performance Java workflow engine.
    • Couler - proj/couler.svg)](https://github.com/couler-proj/couler) - Unified interface for constructing and managing workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.
    • Cromwell - Workflow engine written in Scala and designed for simplicity and scalability. Executes workflows written in [WDL](https://github.com/openwdl/wdl) or [CWL](https://www.commonwl.org/).
    • DolphinScheduler
    • elsa-workflows - workflows/elsa-core.svg)](https://github.com/elsa-workflows/elsa-core) - A .NET Standard 2.0 Workflows Library.
    • easy-rules - easy/easy-rules.svg)](https://github.com/j-easy/easy-rules) - The simple, stupid rules engine for Java.
    • iWF - iWF is a WorkflowAsCode API orchestration platform offering an orchestration coding framework and service for building resilient, fault-tolerant, scalable long-running processes.
    • Kubeflow pipelines - Kubeflow pipelines are reusable end-to-end ML workflows built using the Kubeflow Pipelines SDK.
    • Petri Flow - Petri Net workflow engine for Ruby.
    • FireWorks - FireWorks stores, executes, and manages calculation workflows.
    • Fission Workflows - workflows.svg)](https://github.com/fission/fission-workflows) - A high-perfomant workflow engine for serverless functions on Kubernetes.
    • Flor - A workflow engine written in Ruby.
    • ForML - A development framework and MLOps platform for the lifecycle management of data science projects.
    • Galaxy Project - Galaxy is a scientific tool and workflow system that facilitates reproducibility and transparency by providing a graphical user interface (GUI), a multitude of computational dataset tools, a rich API, and a robust scientific community.
    • Goflow - A simple but powerful DAG scheduler and dashboard, written in Go.
    • Huginn - Create agents that monitor and act on your behalf. Your agents are standing by!
    • Camunda - bpm-platform.svg)](https://github.com/camunda/camunda-bpm-platform) - BPMN-based workflow engine that can be embedded as java library (e.g. Spring Boot) or used standalone, including a graphical modeler and operations tooling.
    • Inngest - An event-driven workflow engine that combines event streams, queues, and durable execution into a single reliability layer.
    • Airflow - airflow.svg)](https://github.com/apache/incubator-airflow) - Python-based platform for running directed acyclic graphs (DAGs) of tasks
    • River Pro - Postgres-backed workflow engine and web dashboard for the River background queue, written in Go.
    • Dagu - A No-code workflow executor. It executes workflows from declarative YAML definitions.
    • Platformeco - Technology platform, allows Product & Project teams easily build micro services using drag & drop UI and operate it, within out of the box cloud and CI/CD tools with deep tracing & monitoring.
    • Brigade - Brigade is a tool for running scriptable, automated tasks in the cloud — as part of your Kubernetes cluster.
    • Didact - The open source .NET job orchestrator.
    • Dapr Workflows - Author and execute durable & long-running Workflow-as-code at scale in Python, Javascript, .NET, Java & Go. Based on the Open-source Durable Task Framework.

  • BPM Suite

    • Activiti - Activiti is a leading lightweight, java-centric open-source BPMN engine supporting real-world process automation needs.
    • Activiti Cloud - is now the new generation of business automation platform offering a set of cloud native building blocks designed to run on distributed infrastructures.
    • jBPM - The core of jBPM is a light-weight, extensible workflow engine written in pure Java that allows you to execute business processes using the latest BPMN 2.0 specification.

  • SAAS

    • AWS Step Functions - Clear workflows for modern applications.
    • Azure Logic Apps - Built on a containerized runtime, deploy and run anywhere to increase scale and portability while automating business-critical workflows.
    • Braze - Power customer-centric interactions between consumers and brands in real-time.
    • Camunda Cloud - A workflow service executing BPMN, providing various language clients, based on the open source project [Zeebe](https://zeebe.io) [![Stars](https://img.shields.io/github/stars/zeebe-io/zeebe.svg)](https://github.com/zeebe-io/zeebe).
    • Corezoid - Hyperautomation engine.
    • Orkes Conductor - Orkes provides Netflix Conductor as a cloud services across all the major cloud providers with enterprise features such as security, integrations and Visual workflow code editor.
    • Google Cloud Workflows - Combine Google Cloud services and APIs to build reliable applications, process automation, and data and machine learning pipelines.
    • Refinery.io - Serverless IDE that allows you to visually build complex workflows (HTTP APIs, map/reduce, etc) on top of AWS Lambda. Supports writing in Python, Node.js, Golang, Ruby, and other languages.
    • Zenaton - Workflow engine for data processes and background jobs available in PHP, Node.js, Python and Ruby.
    • Embed Workflow - Simple native workflow builder for your end-users
    • Orkes Conductor - Orkes provides Netflix Conductor as a cloud services across all the major cloud providers with enterprise features such as security, integrations and Visual workflow code editor.

  • Library (embedded usage)

    • Automatiko - io/automatiko-engine.svg)](https://github.com/automatiko-io/automatiko-engine) - a toolkit to build services and functions based on workflows (primarily BPMN2). Introduces and implements concepts: workflow as a service, workflow as a function and workflow as a function flow.
    • Kogito - runtimes.svg )](https://github.com/kiegroup/kogito-runtimes) - Cloud-native business automation technology. Embeddable to produce JVM or GraalVM artifacts or interacted through Kafka & REST APIs
    • SpiffWorkflow - SpiffWorkflow - a BPMN 2.0 workflow engine implemented in pure Python.
    • Symfony Workflow - Symfony Workflow component - The Workflow component provides tools for managing a workflow or finite state machine in PHP.
    • Viewflow - Reusable workflow library that helps organize people collaboration business logic in django applications.
    • Camunda - bpm-platform.svg)](https://github.com/camunda/camunda-bpm-platform) - BPMN-based workflow engine that can be embedded as java library (e.g. Spring Boot) or used standalone, including a graphical modeler and operations tooling.
Programming Languages
Go 8 Python 7 Java 4 Ruby 3 C# 1 Scala 1 C++ 1 TypeScript 1
Categories
Full fledged product 70 SAAS 11 Library (embedded usage) 6 BPM Suite 3
Sub Categories
Keywords
workflow 13 workflow-engine 11 workflow-automation 6 automation 5 python 5 machine-learning 5 scheduler 4 workflows 4 airflow 4 java 4 golang 4 mlops 4 data-science 3 orchestration 3 workflow-management 3 bioinformatics 3 cloud-native 3 kubernetes 3 dag 3 argo-workflows 2 workflow-orchestration 2 task-scheduler 2 job-scheduler 2 data-pipelines 2 kubeflow 2 apache-airflow 2 orchestrator 2 hpc 2 ai 2 continuous-delivery 2 orchestration-engine 2 data-engineering 2 distributed-systems 2 ruby 2 go 2 genomics 2 docker 2 cloud 2 pipeline 2 directed-acyclic-graph 2 notifications 1 rss 1 bigdata 1 azure 1 aws 1 arvados 1 pipelines 1 scraper 1 twitter 1 twitter-streaming 1