Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with parallel-processing

A curated list of projects in awesome lists tagged with parallel-processing .

https://github.com/sameetasadullah/dependency-analysis-and-speedup-code-snippets

Dependency Analysis is performed on some code snippets and they have been improved in speed if possible

cpp dependency-analysis dependency-types openmp openmp-parallelization parallel-processing parallel-programming speedup

Last synced: 15 Mar 2025

https://github.com/bbs1412/distributedattendancesystem

This is the distributed processing version of the 'Smart Attendance System' project.

attendance-system distributed-computing image-processing machine-learning parallel-processing socket

Last synced: 09 Oct 2025

https://github.com/aarjaneiro/parallelqueue

A package for simulating parallel queueing systems in Python.

discrete-event-simulation parallel parallel-processing python queue simpy simulation

Last synced: 07 May 2025

https://github.com/gauff/belgianelectriccarmarketanalyser

Python tool for analyzing the belgian second hand electric car market by scraping and visualizing data from multiple car listing websites. Features parallel web scraping, price tracking, and interactive dashboards.

automotive beautifulsoup4 car-market dash data-analysis-python data-cleaning data-visualization electric-vehicles market-analysis pandas parallel-processing plotly price-comparison price-monitoring selenium web-scraping-python

Last synced: 22 Jul 2025

https://github.com/narenkhatwani/arkouda-projects

This repository contains the source codes of the projects done using Arkouda (a software package that allows a user to interactively issue massive parallel computations on distributed data using functions and syntax that mimic NumPy, the underlying computational library used in most Python data science workflows.)

arkouda data-analysis data-analytics data-science high-performance high-performance-computing highperformancecomputing numpy pandas parallel-computing parallel-processing parallelization python

Last synced: 30 Mar 2025

https://github.com/aimanamri/raspberry-pi4-hadoop-spark-cluster

This is a self-documentation of learning distributed data storage, parallel processing, and Linux OS using Apache Hadoop, Apache Spark and Raspbian OS. In this project, 3-node cluster will be setup using Raspberry Pi 4, install HDFS and run Spark processing jobs via YARN.

big-data distributed-storage hadoop-cluster hdfs parallel-processing pyspark raspberry-pi-4 spark-cluster spark-shell yarn

Last synced: 09 Apr 2025

https://github.com/Lemniscate-world/HPCS.jl

Building a High-Performance-Computer Simulator in Julia

hypercomputation julia parallel-computing parallel-processing scientific-computing

Last synced: 13 Oct 2025

https://github.com/mishieck/parawait

A JavaScript library for concurrency and parallelism.

async async-await await concurrency javascript library parallel-processing parallelism promises

Last synced: 25 Mar 2025

https://github.com/prince-chrismc/multicore-programming

This is a C++ repository to contain my work for Multicore Programming (COMP426) from Concordia Universirty during Fall 2018.

cpp glew glfw glm modern-cpp multithreading object-oriented-programming opengl parallel-computing parallel-processing tbb

Last synced: 01 Aug 2025

https://github.com/catks/dogell

Run commands on multiple servers in your Datadog Infrastructure

datadog parallel-processing ssh

Last synced: 03 Mar 2025

https://github.com/tradle/multiqueue

Persistent self-ordering multiqueue, for parallelism between queues, and serial..ism within them

javascript multiqueue nag nodejs parallel-processing persistent-queue queue

Last synced: 04 Sep 2025

https://github.com/berkaygediz/quik-portlist

🔍 A speedy tool for parallel port scanning.

host ip-address parallel-processing port port-scanner python quick

Last synced: 09 Oct 2025

https://github.com/prdepyadv/classifyxr.ai

The Customer Support Ticket Classification and Response System combines advance AI models with RAG to automate and elevate ticket categorisation and response generation. By leveraging multi-model integration, sentiment analysis, urgency detection, and vector-based retrieval, it delivers precise, context-aware responses and actionable insights.

context-aware-ai flask genai genai-usecase instructor json json-schema llama3 llm local-llm logging mistral-7b mmr ollama parallel-processing prompting pydantic rag validation

Last synced: 14 Oct 2025

https://github.com/ewpratten/boids-rs

A fast boids library for Rust

boids boids-rust parallel-processing

Last synced: 27 Feb 2025

https://github.com/fahimahammed/parallel-processing-and-distributed-system

This repository features MPI and CUDA parallel computing programs exploring concepts such as matrix multiplication, word counting, synchronous communication, array addition, and CUDA-based algorithms.

c distributed-systems mpi parallel-processing parallel-processing-and-distributed-system

Last synced: 18 Mar 2025

https://github.com/lemniscate-world/hpcs.jl

Building a High-Performance-Computer Simulator in Julia

hypercomputation julia parallel-computing parallel-processing scientific-computing

Last synced: 23 Mar 2025

https://github.com/gjbex/workflows-for-hpc

Materials for a training on workflow tools and best practices for HPC.

bash gnu hpc nextflow parallel parallel-processing slurm workflow workflow-management

Last synced: 15 Mar 2025

https://github.com/xvi-xv-xii-ix-xxii-ix-xiv/snapshotter

This is a directory backup utility that allows you to exclude specific files and directories as defined in a configuration file (config.json). The tool supports multiple configuration sections, such as Python, Rust, or a default section, giving you flexibility over which files and folders to exclude during backup.

backup backup-tool data-backup devops dry-run efficient-backup file-sync incremental-backup multithreading parallel-file-copy parallel-processing rust sha256-verification snapshot

Last synced: 29 Mar 2025

https://github.com/arec1b0/quantum-vqe-project

Optimization of Variational Quantum Eigensolver (VQE) circuits using gradient descent and parallel processing. Includes hyperparameter optimization through random search.

hyperparameter-tuning optimization parallel-processing quantum-computing vqe

Last synced: 04 Apr 2025

https://github.com/xza85hrf/coco-annotation-mask-generator

Python script generates colored masks from COCO-style annotations. It reads the COCO annotation files, creates masks for each annotation, colors the masks based on the annotation's category, and saves the colored masks as images. The script is designed to handle multiple categories and can be easily extended to support more categories if needed.

coco-annotations colored-masks computer-vision data-annotation image-labeling image-masks image-processing makesense-ai mask-generation object-detection opencv parallel-processing pycocotools python segmentation

Last synced: 15 Jul 2025

https://github.com/xza85hrf/flexiblur

FlexiBlur is a Python GUI application that lets users apply various blur effects to images and videos. It supports simple and advanced blur techniques, including custom settings for motion and radial blurs. Designed for systems with OpenCV, FlexiBlur provides a user-friendly interface for easy and efficient media processing.

blur-effects custom-blur image-processing media-blurring media-editing motion-blur opencv parallel-processing python radial-blur region-of-interest video-processing

Last synced: 25 Mar 2025

https://github.com/osl-incubator/retsu

Allow to define specific number of processes in parallel a function could be executed in

celery parallel parallel-processing queues redis

Last synced: 13 Apr 2025

https://github.com/bardifarsi/picalculator

a C++ program that demonstrates the use of a thread pool for efficiently calculating the value of PI using multiple threads. The program utilizes a thread pool to distribute the computation of PI across available CPU cores, improving performance through parallel processing.

cpp cpp14 cpp17 cpp20 multi-threaded multi-threading multi-threads multiprocessing multithread multithreaded multithreading parallel-computing parallel-processing parallel-programming pi pi-calculator thread thread-pool threadpool

Last synced: 19 Jul 2025

https://github.com/trainingbypackt/masteringpython

Build high performance, concurrent, and multi-threaded apps with Python using proven design patterns

benchmarking concurrency cython parallel-processing python-patterns python3

Last synced: 03 Mar 2025

https://github.com/dodotree/webgl_packing

The technique for processing binary (black and white) image data using WebGL.

binery bit-packing gpu-acceleration image-processing parallel-processing texture webgl2

Last synced: 22 Jun 2025

https://github.com/vergissberlin/faker-example-javascript

Real world example for big data creation with javascript. Running javascript in parallel processes.

faker fakerjs parallel-processing

Last synced: 02 Apr 2025

https://github.com/9dl/robotssniffer

Tool to analyze and parse website robots.txt for crawler rules.

csharp parallel-processing robots-txt web-crawling web-scraping

Last synced: 02 Apr 2025

https://github.com/jkapila/parallelwork

This is framework for easly doing parallel processing on data in python.

machine-learning numpy parallel-processing parallelization python

Last synced: 31 Mar 2025

https://github.com/fakufaku/redpoule

A simple thread pool in C++

parallel-processing thread-pool worker-pool

Last synced: 28 Oct 2025

https://github.com/haseebulhassan437/chains-in-langchain

"Advanced LangChain workflows utilizing Google Gemini, OpenAI, and Anthropic for structured AI-driven text processing. This repository includes examples of sequential, parallel, and conditional chains for generating structured outputs, sentiment analysis, summarization, and interactive AI workflows."

conditional-chains langchain-workflows parallel-processing sequential-processing

Last synced: 21 Jun 2025

https://github.com/hafizhhasyhari/pemrograman-data-terdistribusi-parallel-kuliah-s1-2024

Pemrosesan Data Terdistribusi Kuliah S1 A collection of programs from my learning activities in the Distributed Data Programming / Parallel Programming course. This repository is designed to document my journey and encourage community contributions and collaborations

distributed-systems parallel-computing parallel-processing parallel-systems-programming

Last synced: 02 Apr 2025

https://github.com/thesupercd/rainbow_table_builder

A high performance CUDA-based GPU accelerated Rainbow-Table maker, written in C++ without any external libraries or dependencies needed.

cpp cryptography cuda hash-table hashing parallel-processing rainbow-table sha3 sha3-512 uuid

Last synced: 05 Apr 2025

https://github.com/alrifay/parallel-pathfinding-algorithm

Parallel shortest path finding algorithm

csharp parallel-processing shortest-path

Last synced: 11 Mar 2025

https://github.com/seem/fastdaemon

Fast scripts using daemon mode

daemon developer-tools fastai parallel-processing python

Last synced: 17 Mar 2025

https://github.com/pssilva/javafx-acme-corp

Projeto conceito para implementação de Java Aplicações distribuídas usando o JavaFx API. O intuito é utilizar os recursos ociosos, tais como máquinas que estejam em ociosas transformando-as em um nó em um cluster e utilizar o poder de processamento em processamentos distribuídos. No contexto: A pouco tempo a empresa Acme Corporation iniciou suas vendas online e carece de uma plataforma robusta para as vendas. Para que as vendas online tenham sucesso a Acme necessita de um novo serviço web que disponibilize funcionalidades de controle do estoque.

java java-8 javafx javafx-application javafx-desktop-apps microservices parallel-processing

Last synced: 12 Mar 2025

https://github.com/sunsided/shared-files-rs

Disk-Based Single-Writer, Multiple-Reader In-Process File Sharing

file-sharing file-upload parallel-processing rust

Last synced: 29 Oct 2025

https://github.com/scionoftech/parallel_pro

parallel_pro is a simple package for parallel processing

multiprocessing multithreading parallel-processing

Last synced: 07 Oct 2025

https://github.com/futureverse/resources

R package: resources - Resource Specifications for R Evaluations

parallel-processing r-package

Last synced: 02 Aug 2025

https://github.com/syed-m-nofel/text-processing-tool

A Tkinter-based application for text processing and word count analysis. It supports both sequential and parallel processing modes, allowing users to efficiently count word occurrences in large texts. Results can be saved to a file for further use.

parallel-processing python sequential-processing text-processing tkinter tkinter-python

Last synced: 04 Oct 2025

https://github.com/kallistina/multi-threaded-file-server

🖥️Multi-threaded file server for handling concurrent client requests using shared memory, semaphores, and pthreads.

file-server multi-threading parallel-processing pthreads semaphores shared-memory

Last synced: 14 Aug 2025

https://github.com/cluebbers/using_r_for_hpda

Exploring R for high-performance data analytics, including memory management, GPU computing, parallel processing, benchmarks, case studies, and comparisons with Python.

benchmarking case-studies data-science gpu-computing high-performance-data-analytics memory-management parallel-processing python-comparison r

Last synced: 10 Aug 2025

https://github.com/naporin0624/mosaic-art-rust

🎨 High-performance mosaic art generator written in Rust. Creates stunning mosaic images using intelligent color matching, parallel processing, and simulated annealing optimization.

art-generator cli-tool color-matching computer-graphics image-processing mosaic optimization parallel-processing rust simd

Last synced: 01 Oct 2025

https://github.com/thesupercd/server_in_c

A basic implementation of a daemonizable FTP server written in pure C. Also includes a client module that runs independently, with the ability to connect multiple unique instances of itself to the server to offload compute-heavy and parallelizable matrix problems to it.

c ftp-server gauss-jordan-elimination kmeans-clustering matrix-inversion parallel-processing pthreads server socket socket-programming

Last synced: 14 May 2025

https://github.com/bardifarsi/lazyinitialization

This C++20 solution enables lazy initialization for multithreaded tasks. It efficiently initializes an expensive object only when needed, ensuring thread safety. It utilizes std::once_flag and std::atomic<bool> for synchronization, optimizing resource utilization and scalability.

concurrency concurrency-patterns concurrent-programming cpp cpp20 lazy-init lazy-initialization lazyinitializationexception multithreading object-oriented-programming oop parallel-computing parallel-processing parallel-programming singleton singleton-design-pattern singleton-pattern singletons

Last synced: 31 Aug 2025

https://github.com/restuwahyu13/nodejs-other-process

Example implementation worker_threads and child process in nodejs

child-process multithreading nodejs parallel-processing worker-threads

Last synced: 22 Feb 2025

https://github.com/madmann91/parallel

A collection of parallel primitives written with OpenMP

algorithms openmp parallel-processing

Last synced: 14 Mar 2025

https://github.com/csanjeev25/couponsinfo

An Android Application example listing all shopping coupons available

android-application gson java parallel-processing retrofit2 rxandroid2 rxjava2 xml

Last synced: 16 Nov 2025

https://github.com/rushirg/cuda-matrix-multiplication

Matrix Multiplication on GPGPU in CUDA

cpu cuda gpu parallel-processing

Last synced: 15 Mar 2025

https://github.com/nyxflower/mosaics-cuda-openmp

Simple image mosaic command line too (CUDA-OpenMP-C Implementation)

c cuda gpu-programming mosaic mosaic-images openmp parallel-computing parallel-processing

Last synced: 22 Feb 2025

https://github.com/phantie/python_io_parallel_processing_article

Article about parallel processing in python using asyncio, showing the common pitfalls and handling strategies

asyncio beginner-friendly parallel-processing producer-consumer python queue

Last synced: 01 Sep 2025

https://github.com/abhiram-kandiyana/cuda-blast-2024

Reimplementation of NCBI BLAST with CUDA backend for faster retrieval

blast cuda gpu-acceleration parallel-processing

Last synced: 15 Mar 2025

https://github.com/BardiFarsi/ThreadPoolManager

ThreadPoolManager is a C++ project that implements an efficient multi-threading system using a thread pool for generic functions of the same type and different tasks. It includes task management, synchronization mechanisms, and thread-safe logging to demonstrate concurrent task execution.

cpp cpp17 cpp20 cuda cuda-programming memory-management multiprocessing multithreading parallel-computing parallel-processing parallel-programming thread thread-pool thread-safety threadpool threads threadsafe

Last synced: 15 May 2025

https://github.com/leonardoguths/ippd

Repository containing codes and stuff from the Introduction to parallel and distributed processing class.

c distributed-processing mpi openmp parallel-processing

Last synced: 14 May 2025

https://github.com/oeo/processor-rs

High-performance document processing pipeline in Rust. Extracts text, performs OCR, and optimizes images from PDFs and other document formats with parallel processing and memory efficiency.

document-processing image-optimization parallel-processing rust tesseract-ocr text-extraction

Last synced: 10 Jun 2025

https://github.com/thesupercd/cuda_sort

A simple project implementing and measuring the runtime performance metrics related to massively parallel algorithms (radix sort) on an NVIDIA GPU device.

benchmarking c cpp cuda cuda-programming gpu-acceleration gpu-programming multithreading parallel-processing radix-sort sorting-algorithms

Last synced: 30 Mar 2025

https://github.com/leavers/fluentmap

A drop-in Python map replacement featuring parallel and batch processing

batch chunk functional-programming mapreduce parallel-processing python

Last synced: 11 Oct 2025

https://github.com/subho004/retail-pulse

A Go-based microservice to process store visit images in parallel, validate store data, and track job statuses. Includes Docker support, automated testing, and comprehensive error handling. Ideal for high-performance image processing pipelines.

api backend-development concurrency docker go go-mux golang goroutines image-processing job-tracking microservices parallel-processing retail store-data-validation testing

Last synced: 09 Jul 2025

https://github.com/alloc7260/mpfd

A decorator that makes a function into a parallel processor using multithreading.

multithreading parallel-processing python3

Last synced: 09 Jul 2025

https://github.com/somjit101/microsoft-malware-detection

A multi-class classification problem where the task is to classify a file to one of 9 types of Malware usually found in a Windows system, using information from the raw data and metadata of the file.

bag-of-words cross-validation data-mining feature-engineering feature-extraction gradient-boosting k-nearest-neighbors logistic-regression machine-learning microsoft-malware microsoft-malware-detection multi-variate-analysis multiprogramming parallel-processing parallelization random-search t-sne univariate-analysis xgboost

Last synced: 23 Jun 2025

https://github.com/sikatikenmogne/tpl-csharp-workshop

This project is a hands-on workshop focused on exploring and understanding the concepts of parallel programming in C#. It provides practical examples of using delegates, events, and various parallel programming constructs such as Parallel.For, Parallel.ForEach, Parallel.Invoke, and Task.Factory in a console application.

console-application csharp dotnet-framework dotnet-framework-472 jetbrains-rider microsoft mutex mutex-lock parallel-processing parallel-programming task task-parallel-library threading tpl visual-studio

Last synced: 05 Sep 2025

https://github.com/mijay6/operating-system-file-monitoring-tool

Implementation of a folder integrity and malware detection utility that scans directories, detects changes via SHA-256 snapshots, and isolates suspicious files based on heuristic analysis. Developed as an academic project at Politehnica University of Timișoara.

academic-project bash directory-monitoring filesystem hashing integrity-check linux malware-detection monitoring-tool parallel-processing security snapshot

Last synced: 26 Jun 2025

https://github.com/ranfysvalle02/summwebsite

This repository is not intended to serve as the next 'library' for text summarization. Instead, it is designed to be an educational resource, providing insights into the inner workings of text summarization.

ai azure context-length large-text llm map-reduce openai parallel-computing parallel-processing python summaries summarization summarizer

Last synced: 24 Mar 2025

https://github.com/oshanz/elixir_vs_ruby

concurrency and parallelism tests

concurrency elixir parallel-processing ruby

Last synced: 24 Feb 2025

https://github.com/anas-farooq8/parallel-imageprocessing-opencl

OpenCL Image Processing: Explore efficient image processing algorithms using OpenCL, a framework for parallel computing. Convert colored images to grayscale for tasks like skin cancer detection, leveraging the ISIC 2020 Challenge Dataset. Includes optimized parallelized algorithms and documentation for seamless implementation.

c cpu data-parallel gpu-computing grayscale-images image-processing kernel-functions opencl parallel-processing

Last synced: 24 Feb 2025

https://github.com/bardifarsi/threadpoolmanager

ThreadPoolManager is a C++ project that implements an efficient multi-threading system using a thread pool for generic functions of the same type and different tasks. It includes task management, synchronization mechanisms, and thread-safe logging to demonstrate concurrent task execution.

cpp cpp17 cpp20 cuda cuda-programming memory-management multiprocessing multithreading parallel-computing parallel-processing parallel-programming thread thread-pool thread-safety threadpool threads threadsafe

Last synced: 19 Feb 2025

https://github.com/mghorbani2357/dl

DL is cross platform download manager which uses multi-threading to download and manage them.

console-app desktop-application download-manager downloader multithreading parallel-processing python python3 pywebview service-application

Last synced: 05 Apr 2025

https://github.com/milahu/sum-parallel

summarize numbers from a text file using multiple CPU cores

arithmetic arithmetic-summation arithmetics parallel-computing parallel-processing summarization

Last synced: 13 Jun 2025