Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists tagged with dag
A curated list of projects in awesome lists tagged with dag .
https://github.com/chunelfeng/cgraph-lite
A lite and head-only CGraph-API-liked DAG project.
Last synced: 28 Oct 2024
https://github.com/propensive/acyclicity
Monadic directed acyclic graph datastructures for Scala
dag functional-programming graph immutable outgoing-edges scala subgraph
Last synced: 28 Oct 2024
https://github.com/omenapps/django-directed
Tools for building, querying, manipulating, and exporting directed graphs with django
dag directed-graph django graph models postgresql python
Last synced: 19 Oct 2024
https://github.com/fireblade-engine/graph
A lightweight, fast and easy to use directed acyclic graph (DAG) implementation in Swift.
dag directed-acyclic-graph library mit-license spm swift swift-package-manager
Last synced: 09 Dec 2024
https://github.com/onefootball/miniflow
This repository aims to help you have an Airflow installation running in Kubernetes minikube.
airflow apache apache-airflow dag docker kubernetes minikube
Last synced: 21 Nov 2024
https://github.com/riezebosch/gitviz
🔬 Visualize the directed acyclic graph that is your repository!
dag education git graph visualization
Last synced: 04 Dec 2024
https://github.com/matrix-org/eigen-server
Example server and development test client for Linearized Matrix
dag federation ietf linearized matrix mimi
Last synced: 14 Nov 2024
https://github.com/justinmimbs/elm-arc-diagram
An arc diagram for visualizing acyclic digraphs
acyclic-digraph arc-diagram dag elm graph-diagrams
Last synced: 07 Nov 2024
https://github.com/boomerang-io/flow.service.workflow
The backend for front-end microservice for Boomerang Flow, a no-code, cloud-native workflow automation tool. Built in Java using Sprint Boot
automation boomerang dag java spring-boot workflow
Last synced: 19 Nov 2024
https://github.com/thomwright/balamb
🌱 Concurrently run a set of dependent, asynchronous tasks with type-safe dependencies
concurrent dag dags data data-seeding dependency-injection di seed seeding tasks
Last synced: 17 Nov 2024
https://github.com/naupio/pical
(Work In Process) pita is a general distributed computation system with Erlang language base on DAG model. This project is inspired by DouBan 's DPark and Apache Spark.
big-data bigdata dag data distributed distributed-computing distributed-systems erlang erlang-otp flink spark
Last synced: 13 Nov 2024
https://github.com/bonustrack/obyte.io
Obyte.io is a non-financial data explorer for Obyte
Last synced: 10 Dec 2024
https://github.com/hq20/rviz
d3 visulizations :heart_eyes: ready to be used as react components :speak_no_evil:
components d3 d3js dag directed-acyclic-graph forced-directed-graph react visualization
Last synced: 13 Dec 2024
https://github.com/miro-jelaska/sankey.js
Create SVG Sankey diagrams with custom graphics.
dag directed-acyclic-graph flow graphs javascript sankey svg visualisation
Last synced: 04 Nov 2024
https://github.com/fritzbayer/causal-discovery-research-papers
A curated list of causal structure learning research papers with implementations.
bayesian-network bayesian-networks causal-discovery causal-inference causality dag structure-learning
Last synced: 17 Nov 2024
https://github.com/othree/git-graph
Collection of Git diagram samples drawed by gitdags
Last synced: 24 Nov 2024
https://github.com/airflow-laminar/airflow-ha
High Availability (HA) DAG Utility
airflow apache-airflow dag high-availability python scheduler
Last synced: 20 Nov 2024
https://github.com/cbg-ethz/clustnet
Network-based clustering
bayesian-network bayesian-networks clustering dag genomics mixture-model network-clustering
Last synced: 17 Nov 2024
https://github.com/adaszko/roaring-graphs
Graph data structure backed by roaring bitmaps
dag dags directed-acyclic-graph graphs proptest random-dag random-tree
Last synced: 07 Nov 2024
https://github.com/rtradeltd/coredag
Extracted go-ipfs/core/coredag logic
cbor dag ipfs ipld json merkle-dag protobuf
Last synced: 30 Nov 2024
https://github.com/timkpaine/daggre
A convenience layer on top of dagre-d3/dagre-d3-es, for use in ipydagred3
d3 dag dagre dagre-d3 directed-acyclic-graph directed-graph graph graphviz ipywidget ipywidgets jupyter jupyterlab jupyterlab-extension python
Last synced: 27 Oct 2024
https://github.com/swordlet/xdago
XDAGO is an implementation of XDAG in Go. https://xdag.io
blockchain cryptocurrency dag golang gorocksdb miner p2p-network pool randomx wallet xdag xdagger
Last synced: 27 Oct 2024
https://github.com/dirmeier/dag-gnn
A variational autoencoder to learn the DAG of a structural equations model
Last synced: 16 Nov 2024
https://github.com/adilkhash/pycon-ru-2019-etl-examples
Luigi, Airflow, Prefect Examples for PyCon RU 2019 Presentation
airflow dag data-pipeline luigi prefect python
Last synced: 12 Nov 2024
https://github.com/andy2046/rund
a DAG task dependency scheduler
dag directed-acyclic-graph task-runner task-scheduler
Last synced: 26 Nov 2024
https://github.com/kengz/torcharc
TorchArc: Build PyTorch networks by specifying architectures.
dag deep-learning neural-architectures neural-network neural-network-architectures perceiver perceiverio pytorch
Last synced: 20 Oct 2024
https://github.com/cocol-project/probfin
Probabilistic Finality for Crystal
blockchain cocol crystal crystal-lang crystal-language dag finality probabilistic-finality topsort
Last synced: 13 Dec 2024
https://github.com/xdagger/xips
XDAG Improvement Proposals (XIPs) describe standards for the XDAG platform, including core protocol specifications, client APIs, and so on.
Last synced: 11 Nov 2024
https://github.com/jdoiro3/git-dag
At its core Git is a content addressable database. Git-DAG allows you to view this database as a 3d model.
3d dag data-structures educational force-graph git visualization
Last synced: 29 Nov 2024
https://github.com/alexanderlapygin/dags
A set of modules that implements a Directed Acyclic Graph and some related functionality
cd ci clean-architecture dag graph lerna lib library monorepo ts typescript
Last synced: 05 Dec 2024
https://github.com/boomerang-io/worker.flow
The default out of the box worker for Boomerang Flow tasks
automation boomerang dag kubernetes low-code worker workflow
Last synced: 19 Nov 2024
https://github.com/rubcv/iota
:four_leaf_clover: IOTA - Directed Acyclic Graph (DAG) Distributed Ledger
blockchain dag decentralized-applications directed-acyclic-graph distributed iota ledger
Last synced: 21 Nov 2024
https://github.com/lightjameslyy/stargo
STAR(Scheduling Tasks Asynchronously at Runtime) using Golang
Last synced: 11 Nov 2024
https://github.com/rudderlabs/rudder-airflow-provider
Rudderstack provider for Apache Airflow
airflow dag rudderstack scheduler
Last synced: 10 Nov 2024
https://github.com/burcgokden/llm-from-power-law-decoder-representations
Implementation of PLDR-LLM: Large Language Model from Power Law Decoder Representations
dag deep-learning directed-acyclic-graph keras large-language-models llm machine-learning natural-language-processing nlp pldr-llm power-law-decoder-representations power-law-graph-attention tensorflow transformer
Last synced: 20 Dec 2024
https://github.com/erdogant/bnclassify
bnlearn
bayesian-inference bayesian-structure-learning dag directed-acyclic-graph inference python structure-learning
Last synced: 07 Dec 2024
https://github.com/streamingflow/d4py
New dispel4py streaming workflow repo
dag data-pipeline dataflow pipeline-framework python3 streaming workflow-engine workflow-management-system workflows
Last synced: 03 Dec 2024
https://github.com/bsdelf/dag-maker
DAG Maker
dag dependency-injection dependency-resolution directed-acyclic-graph javascript topological-sorting typescript
Last synced: 20 Dec 2024
https://github.com/sarat1669/dag
Directed Acyclic Graph with support for multiple connections between nodes using Ports (Directed Acyclic Multigraph)
acyclic dag directed fbp graph java multigraph port
Last synced: 18 Nov 2024
https://github.com/omar-azmi/tsignal_ts
A topological order respecting signals library inspired by SolidJS. What's topological ordering you ask? Check out the readme to understand the problem with most signal libraries.
dag data-flow deno dependency-free effects es6 events modular reactive reactive-programming reactivity signals solidjs state-management tiny topological-sort typescript
Last synced: 17 Oct 2024
https://github.com/rusq/dagproc
DAG async processor
acyclic-digraph concurrency dag etl go-etl
Last synced: 13 Dec 2024
https://github.com/xmapst/osreapi
An API for cross-platform custom orchestration of execution steps without any third-party dependencies. Based on DAG, it implements the scheduling function of sequential execution of dependent steps and concurrent execution of non-dependent steps.
batch-script cicd dag executor golang powershell python shell
Last synced: 14 Oct 2024
https://github.com/j6k4m8/frof
frof runs other frofs
dag dependency-manager frof job-scheduler python queue slurm slurm-job-scheduler workflow workflow-automation
Last synced: 21 Dec 2024
https://github.com/skyzyx/dgr
Sort Graphviz digraph nodes in the order specified by their edges.
dag directed-acyclic-graph directed-graph directed-graphs directedgraph dot edges go golang graph graphviz graphviz-dot graphviz-dot-language nodes terraform terragrunt xkcd
Last synced: 16 Dec 2024
https://github.com/enj/hivemind
A generic system for running medical pipelines
dag directed-graph medical-pipelines mpi mpi4py python python27
Last synced: 18 Nov 2024
https://github.com/lmc-eu/luft
💨 Luft is standard operators replacement for Airflow with declarative DAGs via Yaml file.
airflow dag declarative etl luft workflow
Last synced: 18 Nov 2024
https://github.com/infra-helpers/induction-airflow
Induction to Apache Airflow
airflow apache dag dependency engine graph orchestration orchestrator server workflow
Last synced: 16 Dec 2024
https://github.com/guilhem/dag
Directed Acyclic Graph (DAG) implementation.
Last synced: 22 Dec 2024
https://github.com/mrlsd/dag-chain
DAG chain platform
chain dag decentralized destributed ledger smart-contracts
Last synced: 10 Nov 2024
https://github.com/jbris/nextflow-tutorials
Working through NextFlow tutorials. See https://github.com/nextflow-io/training
dag directed-acyclic-graph docker groovy groovy-language nextflow nextflow-dsl2 nextflow-lang nextflow-language nextflow-pipeline nextflow-pipelines nextflow-process nextflow-training nextflow-tutorial nextflow-tutorials nextflow-workflow pipeline pipelines workflow workflows
Last synced: 13 Nov 2024
https://github.com/boomerang-io/flow.service.engine
The backend DAG processing engine for Boomerang Flow, a no-code, cloud-native workflow automation tool. Built in Java using Sprint Boot
automation dag java spring-boot workflow
Last synced: 19 Nov 2024
https://github.com/juftin/airflow
Multi Container Airflow DAG Application
airflow dag docker-compose pipeline python3
Last synced: 23 Nov 2024
https://github.com/caicloud/cyclone-website
Source for the Cyclone website https://cyclone.dev
ai-pipeline ci-cd continuous-delivery continuous-integration dag documentation kubernetes website workflow
Last synced: 16 Nov 2024
https://github.com/shgtkshruch/directed-acyclic-graph
A study on implementing DAG in Ruby
dag graph-algorithms job-scheduler ruby
Last synced: 28 Nov 2024
https://github.com/fistgang/processemployeesetl
An Apache Airflow ETL pipeline to process employee data by downloading, validating, transforming, and loading it into a PostgreSQL database.
airflow airflow-docker-containers dag docker-compose etl-pipeline python
Last synced: 07 Nov 2024
https://github.com/xmapst/autoexecflow
An API for cross-platform custom orchestration of execution steps without any third-party dependencies. Based on DAG, it implements the scheduling function of sequential execution of dependent steps and concurrent execution of non-dependent steps.
batch-script cicd dag executor golang powershell shell
Last synced: 17 Dec 2024
https://github.com/mpolinowski/apache-airflow-intro
Introduction to Apache Airflow
apache-airflow dag data-pipelines machine-learning
Last synced: 30 Nov 2024
https://github.com/timjjting/task-lineage-generator
A simple Task Lineage Diagram Generator
d3 dag data-visualization golang graphviz-dot lineage task
Last synced: 07 Dec 2024
https://github.com/withprecedent/holden
Lightweight, accessible composite data structures for Python
adjacency-list adjacency-matrix composite composite-pattern dag edge-list graph python tree tree-structure
Last synced: 15 Nov 2024
https://github.com/withprecedent/chrisjen
Flexible, extensible, lightweight workflow tools for Python projects
Last synced: 15 Nov 2024
https://github.com/lefteris-souflas/spark-movies-analytics
Utilizing Apache Spark & PySpark to analyze a movie dataset. Tasks include data exploration, identifying top-rated movies, training a linear regression model, and experimenting with Airflow.
apache-airflow cross-validation dag data-splitting hyperparameter-tuning linear-regression model-evaluation one-hot-encoding pipeline pyspark pyspark-mllib pyspark-sql spark-session
Last synced: 13 Nov 2024
https://github.com/boomerang-io/worker.cicd
CICD specific Flow Tasks
automation boomerang dag kubernetes low-code worker workflow
Last synced: 19 Nov 2024
https://github.com/boomerang-io/tasks
Monorepo for Boomerang Tasks
automation boomerang dag kubernetes low-code tasks workflow
Last synced: 19 Nov 2024
https://github.com/suryadev99/data-pipeline-news-api
End to End Data Pipeline for News API using Kafka , Airflow , MongoDB , Elasticsearch and Minio
airflow dag docker elasticsearch kafka minio mongodb
Last synced: 11 Nov 2024
https://github.com/romnn/taski
async DAG task scheduling in Rust (WIP)
async dag rust scheduling task task-runner tokio workflow-engine workflows
Last synced: 18 Nov 2024
https://github.com/calvinlfer/dag-validator
A simple Directed Acyclic Graph validator that detects if cycles are present
dag fp functional-programming scala
Last synced: 10 Nov 2024
https://github.com/mg98/ipfs-replicate
Replicate IPFS' distributed data structure locally, based on network traces.
crawler dag ipfs redisgraph scraper
Last synced: 30 Nov 2024
https://github.com/alexanderepstein/taskade
A DAG framework written in std python
Last synced: 11 Oct 2024
https://github.com/pomelohoho/web-trust-etl-with-airflow-on-aws
This repository builds an automated ETL pipeline using Apache Airflow on AWS EC2 to extract, process, and store website reputation data from the WOT API in AWS S3. It leverages Airflow for scheduling and managing the workflow.
airflow api api-integration automation aws-ec2 aws-s3 dag etl-pipeline python
Last synced: 10 Nov 2024
https://github.com/mcejp/goeiedag
It's like a Makefile, but you define it in Python
build-system dag make makefile ninja ninja-build
Last synced: 21 Nov 2024
https://github.com/teleivo/critic
Identify critical paths in the dependencies of a maven multi-module project
Last synced: 08 Nov 2024
https://github.com/romnn/publish-crates
publish rust crates with support for cargo workspaces.
actions ci-cd crates crates-io dag dependencies publish release-automation rust workspaces
Last synced: 08 Nov 2024
https://github.com/rubnsbarbosa/airflow-data-pipeline
Airflow DAG pipeline which extract data from s3 and load into Redshift
apache-airflow dag pipeline redshift s3-bucket
Last synced: 29 Nov 2024
https://github.com/notcalle/ruby-tangle
Gem for managing undirected and directed graphs
Last synced: 28 Nov 2024
https://github.com/ankitmishralive/ml-dag-pipeline
This project is a comprehensive machine learning dag pipeline designed to predict the potability of water. It integrates various stages of the machine learning lifecycle, from data extraction and cleaning to model training and evaluation.
dag docker dvc light-gbm machine-learning ml-pipeline mlops python
Last synced: 28 Nov 2024
https://github.com/seilylook/deploy_simple_dags_with_airflow_on_kubernetes
Deploy simple DAGs with Airflow on Kubernetes
airflow dag docker helm-chart kubernetes minikube
Last synced: 19 Dec 2024
https://github.com/fisseha-estifanos/elt
A show case repository to use airflow, dbt and data warehouse systems in order to perform an ELT task.
airflow dag data-engineering dbt elt
Last synced: 09 Dec 2024
https://github.com/j-sephb-lt-n/gcp-workflows-example
A simple example showing how Google Cloud Workflows works
cloud dag data-engineering gcp google-cloud google-cloud-platform google-workflows orchestration workflows
Last synced: 07 Nov 2024
https://github.com/gcp-development/web-application
Web2 vs Web3
actix-web asynchronous-programming blockchain cid dag dht ipfs ipfs-protocol ipns kubernetes kubo-rpc-api react rest-api restful-api rust sqlx web-application web3
Last synced: 20 Dec 2024
https://github.com/ramy-badr-ahmed/merkle-dag-matlab
Merkle-Directed Acyclic Graph (DAG) in MATLAB - https://doi.org/10.5281/zenodo.12808889
cryptographic-hash-functions dag data-integrity data-structures-and-algorithms data-verification directed-acyclic-graph graph-algorithms graph-algorithms-and-data-sturcture integrity-check java-security matlab matlab-oop merkle-dag
Last synced: 12 Dec 2024
