Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/launchflow/buildflow
BuildFlow, is an open source framework for building large scale systems using Python. All you need to do is describe where your input is coming from and where your output should be written, and BuildFlow handles the rest. No configuration outside of the code is required.
batch data-science pipeline python streaming
Last synced: 03 Jul 2024
https://github.com/KSF-Media/gitlab-dashboard
📺 TV dashboard for a global view on Gitlab Pipelines
ci gitlab gitlab-ci gitlab-dashboard gitlab-pipelines pipeline tv-dashboard
Last synced: 02 Jul 2024
https://github.com/globocom/functions
An Open Source Serverless Platform
lambda lambda-functions nodejs pipeline serverless
Last synced: 02 Jul 2024
https://github.com/OctoD/effepi
Fun functional programming with pipelinable functions
functional-programming functions pipeline pipeline-framework typescript unicorn
Last synced: 02 Jul 2024
https://github.com/datasciencecampus/optimus
A text processing pipeline for turning unstructured text data into hierarchical datasets
dsc-projects fasttext-model pipeline python
Last synced: 01 Jul 2024
https://github.com/PaddlePaddle/Serving
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dag deep-learning docker gpu micro-service microservice-toolkit online-service paddle paddle-serving pipeline prediction predictor python rpc-service serving
Last synced: 01 Jul 2024
https://github.com/miguelmota/bash-streams-handbook
💻 Learn Bash streams, pipelines and redirection, from beginner to advanced.
awesome bash book example gnu gnu-linux handbook learning linux named-pipes pipeline pipes process-substitution shell standard-streams streams terminal tty tutorial unix
Last synced: 29 Jun 2024
https://github.com/cablehead/nu_plugin_from_sse
Nushell plugin to parse a stream of HTTP server sent events
http nushell nushell-plugin pipeline server-sent-events shell streaming
Last synced: 27 Jun 2024
https://github.com/floeit/floe
floe - code over convention workflow engine - think gocd but actually in go - oh and no xml
continuous-delivery continuous-integration gocd golang jenkins pipeline workflow-engine
Last synced: 27 Jun 2024
https://github.com/mingchen/docker-android-build-box
An optimized docker image includes Android, Kotlin, Flutter sdk.
bitbucket docker-android docker-image dockerfile dockerize fastlane flutter kotlin pipeline
Last synced: 27 Jun 2024
https://github.com/pipelight/pipelight
Tiny automation pipelines. Bring CI/CD to the smallest projects. Self-hosted, Lightweight, CLI only.
automation bash cicd continuous continuous-delivery continuous-deployment continuous-integration continuous-testing devops-tools docker git pipeline rust toml typescript yaml
Last synced: 26 Jun 2024
https://github.com/EpicGamesExt/BlenderTools
Blender addons that improve the game development workflow between Blender and Unreal.
blender blender-addon pipeline python unreal
Last synced: 25 Jun 2024
https://github.com/chasedehan/diaml
Semi-automated machine learning pipelines
automated-machine-learning data-science hyperparameter-tuning machine-learning modular pipeline sklearn tpot
Last synced: 24 Jun 2024
https://github.com/alvesmarcos/research-thesis
A minimalist Automated Machine Learning tool to optimize dynamic vocabularies for translation models :snake: :gem:
automation conda machine-learning neural-network pipeline python tensorflow
Last synced: 24 Jun 2024
https://github.com/ropensci-books/drake
The user manual for the drake R package
data-science drake high-performance-computing makefile pipeline r reproducibility reproducible-research ropensci rstats workflow
Last synced: 21 Jun 2024
https://github.com/jelastic-jps/git-push-deploy
Simple Automated CI/CD Pipeline for GitHub and GitLab Projects
auto-deployment auto-update automatic-deployment automation cd-pipeline ci-automation ci-cd continuous-delivery continuous-deployment continuous-integration delivery-pipeline git git-addons git-integrated github github-webhooks gitlab-ci gitlab-webhook integration-tool pipeline
Last synced: 21 Jun 2024
https://github.com/s8sg/faas-flow
Function Composition for OpenFaaS
automation faas faas-flow function-chain function-composition integration openfaas openfaas-template pipeline pipeline-framework serverless workflow-engine
Last synced: 21 Jun 2024
https://github.com/longbridgeapp/html-pipeline
HTML processing filters and utilities in Go version
go html html-processor markdown pipeline text-processor
Last synced: 21 Jun 2024
https://github.com/tektoncd/dashboard
A dashboard for Tekton!
dashboard hacktoberfest pipeline tekton ui
Last synced: 20 Jun 2024
https://github.com/cgwire/kitsu
Collaboration Platform for Animation and VFX Productions
Last synced: 20 Jun 2024
https://github.com/ArtFXDev/silex-front
Silex front-end app
cgwire graphql kitsu material-ui pipeline react typescript vfx
Last synced: 20 Jun 2024
https://github.com/cpp-lln-lab/bidspm
an SPM centric BIDS app
automated-analysis bids bidsapp closember fmri pipeline spm12
Last synced: 20 Jun 2024
https://github.com/dxatscale/sfpowerscripts
A build system for modular development in Salesforce
nodejs package pipeline salesforce sfdx-cli sfdx-plugin
Last synced: 19 Jun 2024
https://github.com/destel/rill
Go concurrency with channel transformations, type safety, batching and error handling. No boilerplate
channels concurrency functional-programming generics go golang goroutines pipeline streaming
Last synced: 18 Jun 2024
https://github.com/ropensci/drake
An R-focused pipeline toolkit for reproducibility and high-performance computing
data-science drake high-performance-computing makefile peer-reviewed pipeline r r-package reproducibility reproducible-research ropensci rstats workflow
Last synced: 17 Jun 2024
https://github.com/Nesvilab/FragPipe
A cross-platform Graphical User Interface (GUI) for running MSFragger and Philosopher - powered pipeline for comprehensive analysis of shotgun proteomics data
gui mass-spectrometry pipeline proteomics search-engine
Last synced: 17 Jun 2024
https://github.com/camposvinicius/aws-etl
This is an ETL application on AWS with general open sales and customer data that you can find here: https://github.com/camposvinicius/data/blob/main/AdventureWorks.zip, it's a zipped file with some .csvs inside that we will apply transformations.
airflow argocd athena aws catalog data data-engineer database emr emr-cluster etl glue kubernetes pipeline postgres pyspark rds spark
Last synced: 16 Jun 2024
https://github.com/WangXuan95/FPGA-FixedPoint
A Verilog fixed-point lib: custom bit width, arithmetic, converting to float, with single cycle & pipeline version. 一个Verilog定点数库，提供算术运算、与浮点数的互相转换，包含单周期和流水线两种实现。
arithmetic fixedpoint pipeline rtl systemverilog verilog
Last synced: 16 Jun 2024
https://github.com/banzaicloud/spot-termination-exporter
Prometheus spot instance exporter to monitor AWS instance termination with Hollowtrees
hollowtrees pipeline prometheus-exporter spot-instances
Last synced: 16 Jun 2024
https://github.com/realfastvla/rfpipe
Fast radio interferometric transient search pipeline
interferometry pipeline python radio-astronomy transients
Last synced: 16 Jun 2024
https://github.com/vschiavoni/SecureStreams-DEBS17
SecureStreams, DEBS'17
lua mapreduce pipeline reactive-programming security sgx sgx-enclave streaming
Last synced: 15 Jun 2024
https://github.com/bodywork-ml/bodywork-core
ML pipeline orchestration and model deployments on Kubernetes.
batch cicd continuous-deployment data-science devops framework kubernetes machine-learning mlops orchestration pipeline python serving
Last synced: 15 Jun 2024
https://github.com/czheo/syntax_sugar_python
A library adding some anti-Pythonic syntatic sugar to Python
functional parallelism pipeline python syntax-sugar
Last synced: 14 Jun 2024
https://github.com/brigadecore/kashti
Kashti is a dashboard for your Brigade v1 pipelines.
angular brigade ci frontend kubernetes pipeline ui v1
Last synced: 14 Jun 2024
https://github.com/cathive/concourse-chartmuseum-resource
interacts with a Chart Museum instance or Harbor (Kubernetes Helm Charts storage)
chartmuseum ci concourse continuous-delivery continuous-integration deployment helm k8s kubernetes packaging pipeline
Last synced: 14 Jun 2024
https://github.com/kube-HPC/hkube
🐟 High Performance Computing over Kubernetes - Core Repo 🎣
algorithm cluster hkube kubernetes pipeline
Last synced: 14 Jun 2024
https://github.com/instill-ai/instill-core
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
ai api cli developer-tools etl generative-ai golang gpt hacktoberfest llm low-code no-code open-source pipeline python stable-diffusion typescript unstructured-data
Last synced: 14 Jun 2024
https://github.com/MIPT-ILab/mipt-mips
Cycle-accurate pre-silicon simulator of RISC-V and MIPS CPUs
branch-prediction branch-predictor clock-precise computer-architecture computer-architecture-lesson cpu cpu-cache cpu-model mips mips-binutils mipt optimizations pipeline pre-silicon prediction-algorithms risc risc-v simulation simulator
Last synced: 14 Jun 2024
https://github.com/sbstjn/cra-pipeline
Use AWS CDK with CodePipeline to deploy a TypeScript Create-React-App.
aws-cdk aws-codepipeline cra cra-pipeline deployment pipeline react serverless
Last synced: 13 Jun 2024
https://github.com/apache/hop
Hop Orchestration Platform
apache data-integration etl hop java orchestration pipeline streaming workflow
Last synced: 12 Jun 2024
https://github.com/cloudposse/terraform-aws-ecs-codepipeline
Terraform Module for CI/CD with AWS Code Pipeline and Code Build for ECS https://cloudposse.com/
aws codebuild codepipeline docker ecs hcl2 pipeline terraform terraform-module
Last synced: 12 Jun 2024
https://github.com/mlabouardy/pipeline-as-code-with-jenkins
Pipeline as Code with Jenkins
aws azure containers docker gcp jenkins kubernetes lambda packer pipeline serverless terraform
Last synced: 12 Jun 2024
https://github.com/blacklanternsecurity/public-dns-servers
A CI/CD-verified list of the internet's known-good public DNS servers (from public-dns.info) Updated weekly!
automation bbot cicd cicd-pipeline dns dns-resolver dns-server list massdns nameservers osint pipeline public python python3 recon resolvers
Last synced: 12 Jun 2024
https://github.com/marimo-team/marimo
A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.
artificial-intelligence data-science data-visualization developer-tools machine-learning notebooks pipeline python reactive web-app
Last synced: 11 Jun 2024
https://github.com/vectorengine/vectordb
VectorDB is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.
clickhouse database olap pipeline rust storage streaming
Last synced: 11 Jun 2024
https://github.com/m-lab/etl-schema
All schema and views related to the etl pipeline and public bigquery tables.
Last synced: 10 Jun 2024
https://github.com/numeract/rflow
Flexible R Pipelines with Caching
cache data-science pipeline r rflow
Last synced: 10 Jun 2024
https://github.com/Skyscanner/whispers
Identify hardcoded secrets in static structured text
credentials devsecops hardcoded json-parser leaks lint linter parser passwords pipeline secrets secrets-detection secrets-scan security security-compliance structured-data structured-text xml-parser yaml-parser
Last synced: 10 Jun 2024
https://github.com/skyzh/RISCV-Simulator
💻 RISC-V Simulator of RV32I ISA. 5-stage pipeline / out-of-order execution with Tomasulo algorithm and Speculation. Support runtime visualization. Project report available.
branch-prediction cmake computer-architecture cpp cpu gtest pipeline riscv riscv-emulator riscv-simulator riscv32 speculation tomasulo-algorithm
Last synced: 10 Jun 2024
https://github.com/tektoncd/operator
Kubernetes operator to manage installation, updation and uninstallation of tektoncd projects (pipeline, …)
kubernetes kubernetes-operator operator-crd pipeline tektoncd
Last synced: 10 Jun 2024
https://github.com/jenkinsci/multibranch-action-triggers-plugin
MultiBranch Actions Trigger Plugin
declarative declarative-pipeline multibranch multibranch-pipeline pipeline pipeline-job pipeline-trigger trigger trigger-events
Last synced: 09 Jun 2024
https://github.com/pd3f/pd3f
🏭 PDF text extraction pipeline: self-hosted, local-first, Docker-based
extract-text language-model machine-learning ocr parsr pd3f pdf pdf-to-text pipeline python text-extraction
Last synced: 09 Jun 2024
https://github.com/mopsicus/unity-build-pipeline
Custom BASH script for build, archive, export and upload APK and IPA to server with Telegram notification
androd bash build-automation build-tool ios pipeline telegram unity3d xcode
Last synced: 09 Jun 2024
https://github.com/edyoda/data-science-complete-tutorial
For extensive instructor led learning
decision-trees feature-selection linear-regression machine-learning nearest-neighbors numpy pandas pipeline scikit-learn
Last synced: 09 Jun 2024
https://github.com/jenkinsci/ssh-steps-plugin
Jenkins pipeline steps which provides SSH facilities such as command execution or file transfer for continuous delivery.
jenkins jenkins-pipeline pipeline pipeline-step remote-shell ssh steps
Last synced: 09 Jun 2024
https://github.com/jenkinsci/pipeline-utility-steps-plugin
Small, miscellaneous, cross platform utility steps for Jenkins Pipeline jobs.
Last synced: 09 Jun 2024
https://github.com/wcm-io-devops/jenkins-pipeline-library
wcm.io Jenkins Pipeline Library for CI/CD
ci-cd groovy jenkins jenkins-pipeline jenkins-shared-library pipeline
Last synced: 09 Jun 2024
https://github.com/kharchenkolab/dropEst
Pipeline for initial analysis of droplet-based single-cell RNA-seq data
pipeline preprocessing scrna-seq single-cell-rna-seq
Last synced: 09 Jun 2024
https://github.com/oleg-nenashev/demo-jenkins-config-as-code
Demo of Jenkins Configuration-As-Code with Docker and Groovy Hook Scripts
demo-image docker hacktoberfest jenkins jenkins-configuration pipeline pipeline-library
Last synced: 09 Jun 2024
https://github.com/sdparekh/zUMIs
zUMIs: A fast and flexible pipeline to process RNA sequencing data with UMIs
barcodes dge expression fastq pipeline rna-seq rnaseq single-cell umi
Last synced: 09 Jun 2024
https://github.com/ropensci/targets
Function-oriented Make-like declarative workflows for R
data-science high-performance-computing make peer-reviewed pipeline r r-package r-targetopia reproducibility reproducible-research rstats targets workflow
Last synced: 09 Jun 2024
https://github.com/nf-core/sarek
Analysis pipeline to detect germline or somatic variants (pre-processing, variant calling and annotation) from WGS / targeted sequencing
annotation bioinformatics cancer conda containers gatk4 genomics germline next-generation-sequencing nextflow nf-core pipeline pre-processing reproducible-research somatic target-panels variant-calling whole-exome-sequencing whole-genome-sequencing workflow
Last synced: 08 Jun 2024
https://github.com/apptension/saas-boilerplate
SaaS Boilerplate - Open Source and free SaaS stack that lets you build SaaS products faster in React, Django and AWS. Focus on essential business logic instead of coding repeatable features!
aws aws-esc backend boilerplate business cdk django docker frontend hacktoberfest pipeline product python react saas serverless stack typescript vitejs workers
Last synced: 08 Jun 2024
https://github.com/ran-isenberg/aws-lambda-handler-cookbook
This repository provides a working, deployable, open source-based, serverless service template with an AWS Lambda function and AWS CDK Python code with all the best practices and a complete CI/CD pipeline.
aws aws-lambda best-practices cdk cookbook pipeline python serverless template template-repository
Last synced: 08 Jun 2024
https://github.com/ssbostan/jenkins-tutorial
The completest Jenkins tutorial, reference, awesome, examples
automation build build-jenkins cicd devops jenkins jenkins-pipeline jenkinsfile pipeline
Last synced: 08 Jun 2024
https://github.com/Avaiga/taipy
Turns Data and AI algorithms into production-ready web applications in no time.
automation data-engineering data-integration data-ops data-visualization datascience developer-tools hacktoberfest hacktoberfest2023 job-scheduler mlops orchestration pipeline pipelines python scenario scenario-analysis taipy-core taipy-gui workflow
Last synced: 08 Jun 2024
https://github.com/nemonik/hands-on-DevOps
A hands-on DevOps course covering the culture, methods and repeated practices of modern software development involving Packer, Vagrant, VirtualBox, Ansible, Kubernetes, K3s, MetalLB, Traefik, Docker-Compose, Docker, Taiga, GitLab, Drone CI, SonarQube, Selenium, InSpec, Alpine 3.10, Ubuntu-bionic, CentOS 7...
ansible ansible-automation continuous-delivery continuous-integration devops docker docker-image drone gitlab go hands-on-devops-course inspec kubernetes pipeline plantuml selenium sonarqube taiga vagrant virtual-machine
Last synced: 08 Jun 2024
https://github.com/jupyter-naas/naas
Low-code Python library to safely use notebooks in production: schedule workflows, generate assets, trigger webhooks, send notifications, build pipelines, manage secrets (Cloud-only)
ai binder data data-science data-transformation engine etl integration jupyter jupyterlab notebooks open-source pipeline
Last synced: 08 Jun 2024
https://github.com/NeumTry/NeumAI
Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
ai chatgpt data data-engineering database embeddings etl llm llmops mlops ops pipeline python rag retrieval vector-database vectors
Last synced: 08 Jun 2024
https://github.com/ozontech/file.d
A blazing fast tool for building data pipelines: read, process and output events. Our community: https://t.me/file_d_community
actions clickhouse elasticsearch events file gelf go http input json kafka logs observability output pipeline processing reading sre throttle tracing
Last synced: 08 Jun 2024
https://github.com/tektoncd/cli
A CLI for interacting with Tekton!
cli command-line hacktoberfest pipeline tekton
Last synced: 07 Jun 2024
https://github.com/catalyst-team/segmentation
Catalyst.Segmentation
augmentation catalyst deep-learning docker image-processing image-segmentation jaccard machine-learning pipeline python pytorch reproducibility segmentation segmentation-pipeline
Last synced: 07 Jun 2024
https://github.com/catalyst-team/classification
Catalyst.Classification
augmentation catalyst classification classification-pipeline deep-learning docker focal-loss image-classification image-processing machine-learning pipeline python pytorch reproducibility
Last synced: 07 Jun 2024
https://github.com/jgujerry/python-frameworks
Another curated list of Python frameworks
api artificial-intelligence cms data-workflow deep-learning devops distributed-computing frameworks machine-learning messaging parallel-computing pipeline python task-queue web-crawling webapp
Last synced: 07 Jun 2024
https://github.com/argoproj-labs/old-argo-dataflow
Dataflow is a Kubernetes-native platform for executing large parallel data-processing pipelines.
data jetstream kafka kubernetes pipeline
Last synced: 07 Jun 2024
https://github.com/gonglei007/GameDevMind
最全面的游戏开发技术图谱。帮助游戏开发者们在已知问题上节省时间，省出更多的精力投入到更有创造性的工作中去。
3d cpp devops framework game game-development game-framework game-server gamedev management mmorpg pipeline programming roadmap scrum shader unity unity3d unreal-engine unrealengine
Last synced: 06 Jun 2024
https://github.com/vectorengine/vectorsql
VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.
clickhouse column-store distributed-database iot olap pipeline reactive stream-processing
Last synced: 05 Jun 2024
https://github.com/wlandau/targets-shiny
Example Shiny app containing a targets pipeline.
high-performance-computing make pipeline r reproducibility reproducible-research shiny targets workflow
Last synced: 04 Jun 2024
https://github.com/wlandau/targets-tutorial
Short course on the targets R package
data-science make pipeline r r-package reproducibility reproducible-research rstats targets workflow
Last synced: 04 Jun 2024
https://github.com/wlandau/targets-four-minutes
Get started with the {targets} R package in four minutes
make pipeline reproducibility rstats targets
Last synced: 04 Jun 2024
https://alibaba.github.io/dawn/
:sunrise: Dawn is a lightweight task management and build tool for front-end and nodejs.
build build-tool construction dawn dawn-cli front-end javascript middleware nodejs pack pipeline task
Last synced: 03 Jun 2024
https://github.com/tenox7/ttyplot
a realtime plotting utility for terminal/console with data input from stdin
chart cli cli-app command-line-tool commandline console console-tool cpu graph ping pipe pipeline plot realtime sar snmp snmp-network-throughput snmpget stdin
Last synced: 03 Jun 2024
https://github.com/iam-veeramalla/Jenkins-Zero-To-Hero
Install Jenkins, configure Docker as slave, set up cicd, deploy applications to k8s using Argo CD in GitOps way.
argocd cicd docker gitops jenkins kubernetes pipeline
Last synced: 02 Jun 2024
https://github.com/Roman2K/scat
Decentralized, trustless backup tool
backup cloud decentralized pipeline raid reed-solomon
Last synced: 02 Jun 2024
https://github.com/pypyr/pypyr
pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.
automation cd ci ci-cd continuous-deployment continuous-integration devops pipeline pipeline-processor pipeline-runner pipelines pipelines-yaml python script script-loader task-manager task-runner taskrunner tool
Last synced: 31 May 2024
https://github.com/alibaba/dawn
:sunrise: Dawn is a lightweight task management and build tool for front-end and nodejs.
build build-tool construction dawn dawn-cli front-end javascript middleware nodejs pack pipeline task
Last synced: 31 May 2024
https://github.com/pszemraj/textsum
CLI & Python API to easily summarize text-based files with transformers
batch-processing inference inference-api pipeline summarization summary text text-to-text-transformer transformer transformers
Last synced: 31 May 2024
https://github.com/jbogard/bulk-writer
Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.
bulk-writer etl etl-job pipeline pipeline-stage sql sqlbulkcopy stream-data
Last synced: 31 May 2024
https://github.com/xljiulang/KestrelApp
基于Kestrel的网络编程应用示例
http http-proxy https kestrel middleware pipeline socket tcp-server
Last synced: 30 May 2024
https://github.com/antonmi/flowex
Flow-Based Programming framework for Elixir
Last synced: 30 May 2024
https://github.com/tc39/proposal-pipeline-operator
A proposal for adding a useful pipe operator to JavaScript.
javascript operator pipeline proposal syntax tc39
Last synced: 30 May 2024
