Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with parallel-processing

A curated list of projects in awesome lists tagged with parallel-processing .

https://github.com/jobrunr/jobrunr

An extremely easy way to perform background processing in Java. Backed by persistent storage. Open and free for commercial use.

background-jobs java java-8 java-scheduler parallel-processing quartz scheduled-jobs scheduler scheduling

Last synced: 13 May 2025

https://github.com/wagoodman/bashful

Use a yaml file to stitch together commands and bash snippits and run them with a bit of style. Why? Because your bash script should be quiet and shy-like (...and not such a loud mouth).

bash build-tool golang installer parallel-processing pretty progress-bar yaml

Last synced: 15 May 2025

https://github.com/futureverse/future

:rocket: R package: future: Unified Parallel and Distributed Processing in R for Everyone

asynchronous cran distributed-computing futures hpc hpc-clusters parallel-computing parallel-processing parallelization programming promises r

Last synced: 12 Dec 2025

https://github.com/amphp/parallel

An advanced parallelization library for PHP, enabling efficient multitasking, optimizing resource use, and application responsiveness through multiple CPU threads.

amphp concurrency multiprocessing parallel parallel-processing php revolt

Last synced: 13 May 2025

https://github.com/swansonk14/p_tqdm

Parallel processing with progress bars

parallel-processing progress-bar tqdm

Last synced: 21 Oct 2025

https://github.com/foo123/filter.js

Video and Image Processing and Computer Vision Library in pure JavaScript (Browser and Node.js)

browser computer-vision glsl image-processing machine-learning node-js parallel-processing real-time video-processing wasm web-assembly webgl

Last synced: 16 May 2025

https://github.com/foo123/FILTER.js

Video and Image Processing and Computer Vision Library in pure JavaScript (Browser and Node.js)

browser computer-vision glsl image-processing machine-learning node-js parallel-processing real-time video-processing wasm web-assembly webgl

Last synced: 05 Apr 2025

https://github.com/uob-hpc/babelstream

STREAM, for lots of devices written in many programming models

benchmark cuda gpgpu gpu hpc kokkos memory-bandwidth openacc opencl openmp parallel-processing raja sycl

Last synced: 21 Oct 2025

https://github.com/UoB-HPC/BabelStream

STREAM, for lots of devices written in many programming models

benchmark cuda gpgpu gpu hpc kokkos memory-bandwidth openacc opencl openmp parallel-processing raja sycl

Last synced: 21 Apr 2025

https://github.com/futureverse/future.apply

:rocket: R package: future.apply - Apply Function to Elements in Parallel using Futures

asynchronous distributed-computing future hpc hpc-clusters package parallel parallel-computing parallel-processing parallelization programming r

Last synced: 12 Dec 2025

https://github.com/WZBSocialScienceCenter/tmtoolkit

Text Mining and Topic Modeling Toolkit for Python with parallel processing power

evaluation nlp parallel-processing python socialscience text-processing topic-modeling

Last synced: 03 May 2025

https://github.com/lvyahui8/spring-boot-data-aggregator

基于注解实现并行地依赖注入（数据聚合），可以看做 Spring Async 注解的升级版

bean-mapping concurrency data-aggregation parallel-processing spring-boot

Last synced: 06 Sep 2025

https://github.com/eXascaleInfolab/PyExPool

Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture

application-framework benchmarking-framework cache-control execution-pool in-memory-computations load-balancing monitoring-server multiprocessing numa parallel-computing parallel-processing task-queue

Last synced: 02 Apr 2025

https://github.com/BeRo1985/kraft

Kraft Physics Engine is an open source Object Pascal physics engine library that can be used in 3D games.

3d delphi freepascal game-development gamedev multithreaded object-pascal parallel-processing pascal physics physics-engine

Last synced: 15 Mar 2025

https://github.com/futureverse/future.callr

:rocket: R package future.callr: A Future API for Parallel Processing using 'callr'

asynchronous futures parallel-computing parallel-processing parallelization programming promises r

Last synced: 05 May 2025

https://github.com/HenrikBengtsson/future.callr

:rocket: R package future.callr: A Future API for Parallel Processing using 'callr'

asynchronous futures parallel-computing parallel-processing parallelization programming promises r

Last synced: 02 Apr 2025

https://github.com/mayankpratap/samchika

A fast and light-weight multithreaded file processing library for Java.

concurrency file-processing java kotlin multithreading open-source parallel-processing performance scala

Last synced: 26 Jun 2025

https://github.com/keberwein/mlbgameday

Multi-core processing of 'Gameday' data from Major League Baseball Advanced Media. Additional tools to parallelize large data sets and write them to a database.

baseball database etl mlb-gameday mlbam parallel-processing statistics

Last synced: 03 Apr 2025

https://github.com/baggepinnen/threadtools.jl

Some tools for working with threads in Julia

parallel-computing parallel-processing thread threading threads

Last synced: 15 Mar 2025

https://github.com/seantanly/elixir-paratize

Elixir library providing some handy parallel processing facilities that supports configuring number of workers and timeout.

elixir-library parallel-processing

Last synced: 21 Oct 2025

https://github.com/jimouris/parallel-convolution

🖼️ Parallel Image Convolution, applying a blur filter to images. Written in C, optimized in three different ways: MPI, MPI & OpenMP and CUDA.

blur-filter cuda image-convolution image-processing mpi mpi-library parallel-processing

Last synced: 08 Apr 2025

https://github.com/mattmahn/gitall.rs

Run Git commands in all subdirectories really fast

git hacktoberfest parallel parallel-processing

Last synced: 27 Mar 2025

https://github.com/albertnadal/mandelbrotgolang

Distributed computing of the Mandelbrot set using GoLang, gRPC and RayLib

distributed-computing golang grpc grpc-go mandelbrot mandelbrot-fractal mandelbrot-set parallel-processing raylib

Last synced: 12 Apr 2025

https://github.com/hageldave/imagingkit

Java library for imaging tasks that integrates well with the java.awt.image environment

image-manipulation image-processing java-lambda java-library java8 maven parallel-processing

Last synced: 10 Apr 2025

https://github.com/michaeljwelsh/ppipe

A simple and lightweight Rust library for making iterator pipelines concurrent

adaptor iteration lightweight-rust-library loop multithreading parallel-processing pipeline rust

Last synced: 08 Oct 2025

https://github.com/simple-automation-testing/process-rerun

Run your processes in parallel mode with possibility to re-run them on fail

flaky-proceses flaky-tests parallel-execution parallel-processing processing ret retry

Last synced: 18 Jun 2025

https://github.com/teilomillet/enzu-go

A framework for building multi-agent AI systems. Enables LLMs to collaborate through hierarchical organization, parallel task execution, and extensible tools.

agent-systems agents ai-frame anthropic anthropic-claude chatgpt distributed-agents genai go golang llm llms multi-agent multi-agent-systems openai parallel-processing swarm synergy task tool-integration

Last synced: 01 Apr 2025

https://github.com/famzah/mpssh-py

Mass Parallel Secure Shell command execution

multi-platform parallel-processing ssh-client

Last synced: 07 Apr 2025

https://github.com/sunrise2575/dist-ffmpeg

Distributed & Parallel FFmpeg Transcoder

ffmpeg korean parallel-processing python transcoding vp9

Last synced: 14 Apr 2025

https://github.com/henrikbengtsson/future-tutorial-user2022

Tutorial: An Introduction to Futureverse for Parallel Processing in R (useR! 2022)

future futureverse parallel-processing r-language tutorial user2022

Last synced: 10 Apr 2025

https://github.com/khaledashrafh/riemann-zeta

This repository contains an MPI program written in C that calculates the Riemann zeta function and evaluates its performance using MPI collective communication functions. The program approximates the value of ζ(3) with a given value of `s` (3 - Apéry's constant). It calculates the runtime, speedup, and efficiency for different numbers of processes.

apery gcc-complier high-performance high-performance-computing mpi mpi-reduce mpicc-compiler parallel-computing parallel-processing riemann-zeta time-series

Last synced: 17 Oct 2025

https://github.com/nikhiljsk/preprocess_nlp

A fast framework for pre-processing (Cleaning text, Reduction of vocabulary, Feature extraction and Vectorization). Implemented with parallel processing using custom number of processes.

cleaning-data feature-extraction glove natural-language-processing nlp parallel-processing preprocess python3 reduction spacy stages tfidf vectorization word2vec

Last synced: 12 Apr 2025

https://github.com/okbalefthanded/guesemha

A multiprocess MATLAB toolbox for parallel hyperparamater tuning for Machine Learning applications

cross-validation hyperparameter-tuning matlab parallel-processing

Last synced: 21 Sep 2025

https://github.com/zabir-nabil/darknet-multi-gpu-parallel

running multiple darknet models in parallel in multi-gpu setup

darknet multi-gpu parallel-processing yolo

Last synced: 26 Jul 2025

https://github.com/futureverse/futureverse

[BETA] R package: Easily Install and Load the 'Futureverse'

futureverse parallel-processing r-package

Last synced: 24 Apr 2025

https://github.com/sbl-sdsc/df-parallel

Comparison of Dataframe libraries for parallel processing of large tabular files on CPU and GPU.

cuda-toolkit dask dask-cudf dask-dataframes dataframes gpu-computing parallel-processing pyspark-dataframes rapidsai

Last synced: 12 Apr 2025

https://github.com/wbaldoumas/atrea-policyengine

A modular, composable policy engine for easy implementation of complex conditional processing pipelines.

dotnet engine hacktoberfest nuget nuget-package package parallel-processing policy policy-engine

Last synced: 10 Oct 2025

https://github.com/aiafterdark/lors

LORS (Local O1 Reasoning System) - A distributed reasoning framework using local LLMs for advanced prompt analysis and response generation through parallel processing pipelines. Implements multi-agent architecture with dynamic scaling for complex query processing.

artificial-intelligence async-programming deep-learning distributed-systems llm machine-learning multi-agent-systems natural-language-processing ollama parallel-processing prompt-engineering python

Last synced: 22 Apr 2025

https://github.com/khaledashrafh/ages-distribution-histogram

This program implements a histogram using MPI and OpenMP to analyze a dataset containing group ages that watch a TV show. The goal is to calculate statistics about the groups of age and generate a frequency histogram.

gcc-complier high-performance high-performance-computing histogram message-passing-interface mpi multithreading open-mp openmp parallel-computing parallel-processing

Last synced: 17 Oct 2025

https://github.com/lloydmeta/gol-rs

Conway's Game of Life in Rust + OpenGL

game-of-life gfx gfx-rs opengl parallel-processing rayon rust

Last synced: 28 Jul 2025

https://github.com/darsan-in/remige

Remige is an advanced image compression framework, built as a fork of libSquoosh. By integrating Squoosh's powerful image codecs directly into JavaScript applications, Remige offers unparalleled compression performance and file size reduction. Designed for compatibility with the latest Node.js versions, Remige enhances image processing with modern

auto-optimizer batch-processing ci-cd-pipelines high-performance-tools image-compression image-encoding image-optimization image-preprocessing image-processing-pipeline image-resizing javascript-codecs memory-management modern-development node-js-integration node-js-library open-source-projects parallel-processing performance-enhancement squoosh-fork web-development

Last synced: 04 Oct 2025

https://github.com/andersonreisoares/divideandsegment

This code tackle the problem of creating tiles for parallel segmentation.

image-processing image-segmentation parallel-processing

Last synced: 25 Mar 2025

https://github.com/sean-bradley/cudalookupsha256

SHA256 Lookup using parallel processing on a NVidia CUDA Compatible Graphics card

cuda parallel-processing sha256

Last synced: 05 May 2025

https://github.com/pothosware/pothosopencl

Support for OpenCL-based processing blocks

dataflow dma gpu opencl parallel-processing pothos pothos-framework

Last synced: 06 Jul 2025

https://github.com/sean-bradley/cudalookupripemd60

RipeMD160 Lookup using parallel processing on NVidia CUDA Graphics card

cuda parallel-processing ripemd160

Last synced: 05 May 2025

https://github.com/noahsub/orthographic-renderer

A tool for rendering orthographic views of 3D models, designed to replace traditional CPU rendering in CAD software. It is optimized for both speed and quality, featuring parallel rendering capabilities and GPU acceleration via OPTIX and CUDA.

3d-models avalonia blender dotnet parallel-processing rendering

Last synced: 10 Apr 2025

https://github.com/khaledashrafh/mpi-student-grade-checker

It's a high-performance computing program that utilizes MPI to process a list of student grades in parallel and determine which students have passed the exam and which ones need to repeat it.

gcc-complier grade-checker high-performance-computing message-passing-interface mpi parallel-computing parallel-processing student-grade-application student-success-failure-detection

Last synced: 28 Mar 2025

https://github.com/jvk75/parallelswift

Simple parallel function executer

ios parallel parallel-processing swift

Last synced: 24 Feb 2025

https://github.com/eraclitux/parallel

Go package that simplifies parallel execution of tasks.

golang-package parallel-processing

Last synced: 29 Jul 2025

https://github.com/paulvirally/buddhabrot

Constructs a Buddhabrot using parallel processing

buddhabrot mandelbrot parallel-processing

Last synced: 28 Mar 2025

https://github.com/kristofferv98/agent_nexus

Agentic framework for dynamic function calling across latest LLMs (gpt-4o, gemini-2.0-flash, groq modes, and anthropic models). Converts Python functions into provider-specific schemas for autonomous tool use. Features unified API, JSON schema generation, and integrated tool execution handling.

agent-orchestration agents anthropic function-calling gemini gemini-2-0-flash-exp gemini-tools groq json-schema llm-inference multi-llm openai parallel-processing schema-generation tool-generator tool-integration tools

Last synced: 07 Apr 2025

https://github.com/mathewsbuzetti/powershell-folder-comparison-tool

Ferramenta PowerShell para comparação avançada de pastas com relatório visual HTML, processamento paralelo e rastreamento de sincronização. Ideal para verificar diferenças entre pastas de rede e locais.

backup-verification data-visualization directory-sync file-comparison file-management folder-sync html-report network-drives parallel-processing powershell windows-utility

Last synced: 21 Aug 2025

https://github.com/khaledashrafh/k-means-clustering

This program implements the K-means clustering algorithm using OpenMP APIs. The K-means algorithm is a popular method of vector quantization that aims to partition n observations into k clusters. Each observation is assigned to the cluster with the nearest mean, serving as a prototype of the cluster.

euclidean-distances gcc-complier high-performance-computing k-means-algorithm k-means-clustering open-mp openmp parallel-processing

Last synced: 28 Mar 2025

https://github.com/legalaspro/marl-ppo-suite

Clean, documented implementations of PPO-based algorithms for cooperative multi-agent reinforcement learning, focusing on SMAC environments. Features MLP and RNN-based MAPPO and HAPPO with various techniques.

automation docker happo heterogeneous-agents mappo multiagent-learning multiagent-reinforcement-learning multiagents parallel-processing ppo pytorch reinforcement-learning-algorithms rnn-gru rnn-pytorch runpods smac smacv2 starcraft2 wandb

Last synced: 28 Jul 2025

https://github.com/dkauf42/bayota

Framework for identifying cost-effective, optimal strategies for watershed pollutant reduction in the Chesapeake Bay Program's Phase 6 Watershed Model

decision-support docker optimization-framework parallel-processing python water-quality

Last synced: 21 Mar 2025

https://github.com/massimo-marino/parallel-letter-frequency

Count the frequency of letters in texts using parallel computation.

alphabet btree go golang letter-frequency parallel-algorithm parallel-processing parallelism

Last synced: 14 May 2025

https://github.com/konstantin-bogdanoski/pidp

Паралелно и Дистрибуирано Процесирање (Parallel and DIstributed Processing)

fcse finki parallel-computing parallel-processing parallel-programming

Last synced: 22 Feb 2025

https://github.com/ornl/flowcept

Runtime data integration system that empowers any data processing system to capture and query workflow provenance using data observability.

big-data dask data-integration lineage machine-learning mlflow model-management parallel-processing provenance reproducibility responsible-ai scientific-workflows tensorboard trustworthy-ai workflows

Last synced: 30 Jul 2025

https://github.com/walpurga03/rust-btc-passphrase-finder

Bitcoin Passphrase Finder is a Rust-based tool that iterates through a list of possible passphrases to find the one that matches a specific Bitcoin address. It uses parallel processing to efficiently check the passphrases and supports configurable thread count for optimal performance.

address-generation bitcoin brute-force mnemonic open-source parallel-processing passphrase rust seed-phrase wallet-cracking

Last synced: 15 May 2025

https://github.com/ashirwadpradhan/tpsql

Asynchronous execution of parallely executing SQL query

asynchronous-tasks asyncio parallel-processing query-optimization spark-sql sql

Last synced: 06 Mar 2025

https://github.com/kathleenwest/advancedformapplicationv

This is a very simple windows form application that I completed for a class assignment. It is shown here to illustrate my coding style, structure, and commenting. This example is considered Level 3 – Advanced. Objectives: Task Parallel Library TPL Parallel.ForEach ProgressBar Windows Forms Action delegate Cancelling Tasks CancellationTokenSource Calculating PI cross-thread synchronization recursion Tasks ContinueWith TaskContinuationOptions

asynchronous-programming calculating-pi cancellation cancellation-handling cancellationtoken cross-thread csharp csharp-code delegates mathematics parallel-processing parallel-programming progress-bar recursion synchronization task-management task-parallel task-parallel-library tasks windows-forms

Last synced: 11 Jun 2025

https://github.com/teilomillet/enzu

A framework for building multi-agent AI systems. Enables LLMs to collaborate through hierarchical organization, parallel task execution, and extensible tools.

agent-systems agents ai-frame anthropic anthropic-claude chatgpt distributed-agents genai go golang llm llms multi-agent multi-agent-systems openai parallel-processing swarm synergy task tool-integration

Last synced: 03 Sep 2025

https://github.com/jovannypcg/back-to-the-future-clj

Small and straightforward example on parallel processing using futures in Clojure.

clojure functional-programming futures parallel-processing

Last synced: 11 Jul 2025

https://github.com/trevorhobenshield/quicklabel

Quick dataset labeling using quantized (PTQ) models in PyTorch, TensorFlow, and Keras

deep-learning keras parallel-processing pytorch tensorflow

Last synced: 03 Dec 2025

https://github.com/emanguy/cs483-mcts-othello

A serial/parallel implementation of an Othello AI using Monte Carlo Tree Search.

mcts othello-game parallel-processing

Last synced: 09 Dec 2025

https://github.com/vladimirrotariu/parallel-monte-carlo-simulations

A package to orchestrate parallel (Monte Carlo) simulations via Apache Beam for an arbitrary number of models, with low-level parameter granularity, and flexible random number generator choice.

apache-beam apache-spark data-engineering monte-carlo-simulation parallel-computing parallel-processing python quantitative-finance random-number-generators

Last synced: 06 Mar 2025

https://github.com/atanzu/conveyorpp

A simple С++ library for building conveyor-like pipelines

parallel-algorithm parallel-processing sequencing thread-library

Last synced: 22 Mar 2025