Projects in Awesome Lists tagged with pipeline-framework
A curated list of projects in awesome lists tagged with pipeline-framework .
https://github.com/google-ai-edge/mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
android audio-processing c-plus-plus calculator computer-vision deep-learning framework graph-based graph-framework inference machine-learning mediapipe mobile-development perception pipeline-framework stream-processing video-processing
Last synced: 21 Apr 2025
https://github.com/google/mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
android audio-processing c-plus-plus calculator computer-vision deep-learning framework graph-based graph-framework inference machine-learning mediapipe mobile-development perception pipeline-framework stream-processing video-processing
Last synced: 02 Apr 2025
https://google.github.io/mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
android audio-processing c-plus-plus calculator computer-vision deep-learning framework graph-based graph-framework inference machine-learning mediapipe mobile-development perception pipeline-framework stream-processing video-processing
Last synced: 02 Apr 2025
https://github.com/nextflow-io/nextflow
A DSL for data-driven computational pipelines
aws bioinformatics cloud dataflow docker groovy hello hpc nextflow pipeline pipeline-framework reproducible-research reproducible-science sge singularity singularity-containers slurm workflow-engine
Last synced: 23 Apr 2025
https://github.com/yuanxiaosc/Entity-Relation-Extraction
Entity and Relation Extraction Based on TensorFlow and BERT. 基于TensorFlow和BERT的管道式实体及关系抽取,2019语言与智能技术竞赛信息抽取任务解决方案。Schema based Knowledge Extraction, SKE 2019
bert-model competition-code entity-extraction pipeline-framework relation-extraction tensorflow
Last synced: 28 Mar 2025
https://github.com/yuanxiaosc/entity-relation-extraction
Entity and Relation Extraction Based on TensorFlow and BERT. 基于TensorFlow和BERT的管道式实体及关系抽取,2019语言与智能技术竞赛信息抽取任务解决方案。Schema based Knowledge Extraction, SKE 2019
bert-model competition-code entity-extraction pipeline-framework relation-extraction tensorflow
Last synced: 12 Apr 2025
https://github.com/pipeless-ai/pipeless
An open-source computer vision framework to build and deploy apps in minutes
artificial-intelligence cloud computer-vision deep-learning ffmpeg gstreamer inference inference-server machine-learning multimedia multimedia-applications object-detection perception pipeline-framework python stream-processing video video-processing vision-framework yolo
Last synced: 14 Apr 2025
https://github.com/yzhao062/combo
(AAAI' 20) A Python Toolbox for Machine Learning Model Combination
aggregation data-mining data-science ensemble-learning machine-learning machine-learning-pipelines model-combination pipeline-framework python
Last synced: 08 Apr 2025
https://github.com/neuraxio/neuraxle
The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right pipeline abstractions to write clean deep learning production pipelines. Let your pipeline steps have hyperparameter spaces. Design steps in your pipeline like components. Compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks and MLOps environments.
deep-learning framework hyperparameter-optimization hyperparameter-search hyperparameter-tuning hyperparameters machine-learning neuraxle parallel pipeline pipeline-framework python-library scikit-learn
Last synced: 09 Apr 2025
https://github.com/Neuraxio/Neuraxle
The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right pipeline abstractions to write clean deep learning production pipelines. Let your pipeline steps have hyperparameter spaces. Design steps in your pipeline like components. Compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks and MLOps environments.
deep-learning framework hyperparameter-optimization hyperparameter-search hyperparameter-tuning hyperparameters machine-learning neuraxle parallel pipeline pipeline-framework python-library scikit-learn
Last synced: 05 Apr 2025
https://github.com/megengine/megflow
Efficient ML solution for long-tailed demands.
computer-vision deep-learning megengine megenginelite pipeline pipeline-framework python3 rust
Last synced: 05 Apr 2025
https://github.com/MegEngine/MegFlow
Efficient ML solution for long-tailed demands.
computer-vision deep-learning megengine megenginelite pipeline pipeline-framework python3 rust
Last synced: 11 Nov 2024
https://github.com/neptune-ai/open-solution-mapping-challenge
Open solution to the Mapping Challenge :earth_americas:
competition crowdai data-science data-science-learning deep-learning kaggle lightgbm machine-learning machine-learning-lab mapping-challenge neptune pipeline pipeline-framework python satellite-imagery unet unet-image-segmentation unet-pytorch
Last synced: 05 Apr 2025
https://github.com/m3dev/gokart
Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.
gokart luigi machine-learning mlops pipeline-framework
Last synced: 20 Apr 2025
https://github.com/thomhurst/ModularPipelines
Write your pipelines in C# !
build build-system build-tool build-tools csharp dotnet dotnet-core dotnetcore pipeline pipeline-deploy pipeline-framework pipelines
Last synced: 18 Nov 2024
https://github.com/s8sg/faas-flow
Function Composition for OpenFaaS
automation faas faas-flow function-chain function-composition integration openfaas openfaas-template pipeline pipeline-framework serverless workflow-engine
Last synced: 07 Apr 2025
https://github.com/analysiscenter/batchflow
BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.
data-science machine-learning pipeline pipeline-framework python python3 workflow workflow-engine
Last synced: 01 Apr 2025
https://github.com/ivanpaulovich/FluentMediator
:twisted_rightwards_arrows: FluentMediator is an unobtrusive library that allows developers to build custom pipelines for Commands, Queries and Events.
chain-methods chain-of-responsibility craftmanship csharp ddd-cqrs dotnet-core event-driven event-handlers event-sourcing fluent-design fluent-interface mediator-pattern message-bus pipeline-framework pipelines tdd
Last synced: 14 Mar 2025
https://github.com/ivanpaulovich/fluentmediator
:twisted_rightwards_arrows: FluentMediator is an unobtrusive library that allows developers to build custom pipelines for Commands, Queries and Events.
chain-methods chain-of-responsibility craftmanship csharp ddd-cqrs dotnet-core event-driven event-handlers event-sourcing fluent-design fluent-interface mediator-pattern message-bus pipeline-framework pipelines tdd
Last synced: 09 Apr 2025
https://github.com/pipefunc/pipefunc
Lightweight function pipeline (DAG) creation in pure Python for scientific workflows 🕸️🧪
dag hpc parallel-computing pipeline-framework pipelines reproducible-research slurm workflow-engine
Last synced: 08 Apr 2025
https://github.com/datajoint/datajoint-python
Relational data pipelines for the science lab
cloud-computing data-analysis data-pipelines databases datajoint mysql pipeline-framework python relational-algebra relational-databases relational-model s3 scientific-computing workflow-management
Last synced: 14 Apr 2025
https://github.com/whitaker-io/machine
Machine is a workflow/pipeline library for processing data
codespaces github-actions golang golang-library golang-package golangci-lint mit-license pipeline pipeline-framework stream-processing streaming-data workflow workflow-engine
Last synced: 14 Mar 2025
https://github.com/pwwang/pipen
A pipeline framework for python
dot jinja2 pipeline pipeline-framework python workflow workflow-engine
Last synced: 12 Apr 2025
https://github.com/maxim2266/strit
Package strit introduces a new type of string iterator, along with a number of iterator constructors, wrappers and combinators.
fluent-interface function-composition golang iteration pipeline-framework string-processing
Last synced: 14 Apr 2025
https://github.com/benfoster/Flo
Lightweight library for composing chain of responsibility pipelines
asp-net asp-net-core csharp flow-based-programming pipeline-framework
Last synced: 18 Apr 2025
https://github.com/benfoster/flo
Lightweight library for composing chain of responsibility pipelines
asp-net asp-net-core csharp flow-based-programming pipeline-framework
Last synced: 12 Apr 2025
https://github.com/marsggbo/torchline
Easy to use Pytorch
demo pipeline-framework pytorch pytorch-lightning torchline
Last synced: 16 Feb 2025
https://github.com/bsc-wdc/compss
COMP Superscalar (COMPSs) is a framework which aims to ease the development and execution of applications for distributed infrastructures, such as Clusters, Grids and Clouds.
c distributed-computing docker hpc java pipeline-framework python singularity slurm workflow-management-system workflows
Last synced: 05 Apr 2025
https://github.com/cginternals/gloperate
C++ library for defining and controlling modern GPU rendering/processing operations.
c-plus-plus c-plus-plus-11 framework opengl-framework pipeline-framework rendering-engine script-injection
Last synced: 15 Dec 2024
https://github.com/saantiaguilera/go-pipeline
Build, execute and represent pipelines (aka workflows / templates) in Go
faas-flow flow flow-control flowframework pipeline pipeline-framework pipeline-processor template template-library workflow
Last synced: 19 Apr 2025
https://github.com/38/plumber
The General-Purpose Cross-Language Dataflow Programming
dataflow-programming flow-based-programming pipeline-framework plumber serverless-framework software-framework
Last synced: 23 Mar 2025
https://github.com/ominibyte/richflow
A Node.js and JavaScript synchronous data pipeline processing, data sharing and stream processing library. Actionable & Transformable Pipeline data processing.
data-flow data-pipeline data-processor data-stream data-transformation flow javascript nodejs pipe-data pipeline-framework streaming-data synchronous
Last synced: 30 Mar 2025
https://github.com/giacbrd/smartpipeline
A framework for rapid development of robust data pipelines following a simple design pattern
data-analysis data-analytics data-mining data-pipelines data-processing data-science dataops design-patterns etl machine-learning mlops pipeline pipeline-framework pipelines reproducibility task-queue workflow
Last synced: 21 Mar 2025
https://github.com/minerva-ml/steppy-toolkit
Curated set of transformers that make your work with steppy faster and more effective :telescope:
data-science deep-learning keras keras-models machine-learning nlp open-source pipeline pipeline-framework python python3 pytorch pytorch-models reproducibility reproducible-research steppy steppy-toolkit steps tensorflow tensorflow-models
Last synced: 20 Jan 2025
https://github.com/nksaraf/lepton-footprint-extraction
Automated building polygon extraction from satellite imagery
automation building-footprints keras pipeline-framework tensorflow vision
Last synced: 15 Apr 2025
https://github.com/xpl/pipez
Function sequencing reloaded
aspect-oriented aspect-oriented-framework aspect-oriented-programming functional-programming javascript javascript-framework javascript-library npm-package pipeline-framework sequencing
Last synced: 13 Apr 2025
https://github.com/gtmoose32/pipeline-framework
Pipeline framework allows you to easily construct and execute linear workflows
component linear nuget pipe pipeline pipeline-framework pipelineframework workflow
Last synced: 11 Apr 2025
https://github.com/pwwang/biopipen
A set of processes/pipelines for bioinformatics
bioinformatics bioinformatics-pipeline bioinformatics-scripts pipeline-framework
Last synced: 14 Jan 2025
https://github.com/Fatal1ty/amqpipe
Twisted based pipeline framework for AMQP
amqp pika pipeline-framework python queue rabbitmq twisted
Last synced: 28 Mar 2025
https://github.com/jsa-aerial/aerobio
Extensible full DAG streaming computation server with services and jobs for RNA-Seq, Tn-Seq, WG-Seq and Term-Seq.
clojure genome-sequencing pipeline-framework pipelines rna-seq streaming-data term-seq tn-seq wg-seq
Last synced: 18 Nov 2024
https://github.com/starlink/orac-dr
The ORAC-DR astronomy data reduction pipeline
astronomy orac-dr perl pipeline-framework
Last synced: 11 Apr 2025
https://github.com/andybrice/pypework
Functional pipeline library for Python
functional functional-programming pipeline pipeline-framework pipelines pipes python syntactic-sugar
Last synced: 25 Mar 2025
https://github.com/plainerman/tictactube
A versatile pipelining library created with media organization in mind.
album dataprocessing genius media metadata metadata-management pipeline pipeline-framework songs soundcloud telegram telegram-bot youtube-dl
Last synced: 10 Apr 2025
https://github.com/ddieruf/dotnet-pipelines
A build pipeline framework for dotnet developers
artifactory automation build-automation build-tools cloud-foundry cloudfoundry concourse dotnet pipeline-framework pipeline-script pipeline-tasks pivotal pivotal-cloud-foundry sonar
Last synced: 19 Apr 2025
https://github.com/pfpack/pfpack-dependency
PrimeFuncPack Dependency is a framework for .NET providing a functional programming based technology to build consistent dependency trees validated in the compile time.
csharp dependency-graph dependency-injection dependency-injection-container dependency-injection-framework dependency-injection-library dependency-injection-pattern dependency-tree dotnet dotnet-core functional-programming inversion-of-control inversion-of-control-container pipeline pipeline-framework pipeline-library pipelines
Last synced: 01 Mar 2025
https://github.com/pfpack/pfpack-core-taggeds
PrimeFuncPack Core.Taggeds is a core pack for .NET consisting of fundamental tagged types targeted for use in functional programming: Optional and Result monads, Tagged Union, as well as the convert extensions.
async-programming asynchronous-programming csharp discriminated-unions disjoint-unions dotnet dotnet-core either-monad functional-programming option-type optional-type pipeline pipeline-framework pipeline-library pipelines result-monad result-type sum-types tagged-unions unit-type
Last synced: 01 Mar 2025
https://github.com/sidmishraw/active_pipeline_framework
An Active Pipeline Framework in Java
active-filters java-8 ood-principles pipeline-framework
Last synced: 04 Mar 2025
https://github.com/stevekm/skidsteer
Task & workflow pipeline framework
bioinformatics bioinformatics-pipeline pipeline pipeline-framework
Last synced: 03 Mar 2025
https://github.com/theaniketraj/ceie
A fully automated repository setup tool for seamless Git workflow management.
branching-strategy ci-cd git git-automation git-branching-workflow git-setup git-workflow npm-package pipeline-framework version-control workflow-automation
Last synced: 21 Mar 2025
https://github.com/streamingflow/d4py
New dispel4py streaming workflow repo
dag data-pipeline dataflow pipeline-framework python3 streaming workflow-engine workflow-management-system workflows
Last synced: 25 Mar 2025
https://github.com/rodrigo-arenas/scikit-pipes
Scikit-Learn useful pre-defined Pipelines Hub
beginner-friendly good-first-issue help-wanted help-welcome machine-learning pipeline-framework scikit-learn scikit-learn-pipelines sklearn sklearn-pipeline
Last synced: 07 Apr 2025
https://github.com/pwwang/pipen-diagram
Draw pipeline diagrams for pipen.
diagram flowchart pipeline pipeline-framework
Last synced: 14 Jan 2025
https://github.com/pwwang/pipen-filters
Add a set of useful filters for pipen templates.
jinja2 liquid pipeline pipeline-framework template
Last synced: 14 Jan 2025
https://github.com/molnarmark/pipey
The tiny (460b) way of using pipes in MTA.
lua mta mtasa multitheftauto pipeline pipeline-framework pipelines
Last synced: 06 Mar 2025
https://github.com/pfpack/pfpack-dependency-registry
PrimeFuncPack Dependency Registry is a library for .NET providing a dependency registrar intended for registering services, including dependency trees built by PrimeFuncPack Dependency, in the .NET dependency injection mechanism.
csharp dependency-graph dependency-injection dependency-injection-container dependency-injection-framework dependency-injection-library dependency-injection-pattern dependency-tree dotnet dotnet-core functional-programming inversion-of-control inversion-of-control-container pipeline pipeline-framework pipeline-library pipelines
Last synced: 01 Mar 2025
https://github.com/pfpack/pfpack-primitives
PrimeFuncPack Primitives is a core library for .NET consisting of useful extensions and predicates making work with functional pipelines, Linq, strings, the nullable feature, etc. easier.
csharp dotnet dotnet-core functional-programming linq nullability pipeline pipeline-framework pipeline-library pipelines predicate predicate-functions predicate-logic predicate-methods predicates yield
Last synced: 21 Feb 2025
https://github.com/catseye/lexeduct
MIRROR of https://codeberg.org/catseye/Lexeduct : Experimental framework for text-processing pipelines in JavaScript (in node or browser)
generative-text live-transformation pipeline-framework text-processing text-transformations
Last synced: 05 Mar 2025
https://github.com/pwwang/pipen-gcs
A plugin for pipen to handle files in Google Cloud Storage
google-cloud google-cloud-storage pipeline pipeline-framework
Last synced: 13 Apr 2025
https://github.com/bhojpur/belaur
The Bhojpur Belaur is an efficient, high performance, software DevOps pipeline management engine applied within the Bhojpur.NET Platform ecosystem for delivery of applications or services.
Last synced: 17 Mar 2025
https://github.com/v1v/jenkins-pipeline-library-skeleton
Jenkins shared library using the Everything as Code practice
jcasc jenkinsci pipeline pipeline-framework
Last synced: 16 Mar 2025
https://github.com/romantomjak/pipeline
Pipes and Filters Pattern implemented in Go
pipeline pipeline-framework pipeline-processor pipes-and-filters
Last synced: 16 Mar 2025
https://github.com/pwwang/pyppl_web
Web client to monitor pipeline processes for PyPPL
Last synced: 29 Mar 2025
https://github.com/khalyomede/piper-php
Puts an end to unreadable PHP code.
cascading input-output php pipe pipeline pipeline-framework pipelines reusable-class reusable-functions
Last synced: 15 Mar 2025
https://github.com/yingding/androidmlflow
An android machine learning pipeline framework to support developers building transfer learning pipeline on android and wear os by google devices with ease.
android android-kotlin android-library android-mlflow androidmlflow kotlin ml pipeline-framework
Last synced: 23 Feb 2025