Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with worker-pool

A curated list of projects in awesome lists tagged with worker-pool .

https://github.com/panjf2000/ants

๐Ÿœ๐Ÿœ๐Ÿœ ants is the most powerful and reliable pooling solution for Go.

ants go goroutine goroutine-pool pool worker-pool

Last synced: 12 May 2025

https://github.com/hibiken/asynq

Simple, reliable, and efficient distributed task queue in Go

asynchronous-tasks background-jobs go golang redis task-queue worker-pool

Last synced: 12 May 2025

https://github.com/andywer/threads.js

๐Ÿงต Make web workers & worker threads as simple as a function call.

isomorphic-javascript javascript multithreading nodejs thread-pool typescript web-worker worker-pool worker-threads

Last synced: 13 May 2025

https://github.com/alitto/pond

๐Ÿ”˜ Minimalistic and High-performance goroutine worker pool written in Go

concurrency go golang golang-library goroutine-pool high-performance pond worker-pool worker-pool-factory

Last synced: 13 May 2025

https://github.com/devinus/poolboy

A hunky Erlang worker pool factory

erlang pool worker-pool

Last synced: 14 May 2025

https://github.com/gammazero/workerpool

Concurrency limiting goroutine pool

concurrency worker-pool

Last synced: 11 May 2025

https://github.com/webpack-contrib/thread-loader

Runs the following loaders in a worker pool

loader multithreading thread webpack webpack-loader worker-pool

Last synced: 12 May 2025

https://github.com/sebastianwessel/quickjs

A typescript package to execute JavaScript and TypeScript code in a webassembly quickjs sandbox

example javascript module package quickjs quickjs-emscripten quickjs-runtime sandbox sandbox-environment typescript wasm webassembly worker worker-pool worker-threads

Last synced: 14 May 2025

https://github.com/albrow/jobs

A persistent and flexible background jobs library for go.

go golang redis worker-pool

Last synced: 14 Mar 2025

https://github.com/poolifier/poolifier

Fast and small Node.js worker_threads and cluster worker pool

computing concurrency cpu eventloop javascript nodejs parallelism performance scheduling threadpool typescript worker-pool

Last synced: 10 Apr 2025

https://github.com/acaloiaro/neoq

Queue-agnostic background job library for Go, with a pleasant API and powerful features.

async asynchronous-tasks background-jobs distributed-systems golang postgres task-queue worker-pool worker-pool-go

Last synced: 29 Aug 2025

https://github.com/developit/task-worklet

Task Worklet: explainer, polyfill and demos.

threading threadpool worker worker-pool worklet

Last synced: 09 Apr 2025

https://github.com/fredwu/opq

Elixir queue! A simple, in-memory queue with worker pooling and rate limiting in Elixir.

back-pressure demand-control elixir fifo gen-stage genstage in-memory opq pool pooling queue rate-limit worker-pool

Last synced: 12 Apr 2025

https://github.com/goptics/varmq

A Simplest Storage-Agnostic and Zero-dep Message Queue for Your Concurrent Go Program

concurrency distrubted-systems go goroutine goroutine-pool message-queue persistence pool priority-queue queue varmq worker worker-pool

Last synced: 28 Sep 2025

https://github.com/h2337/cppq

Simple, reliable & efficient distributed task queues for C++17

asynchronous-tasks background-jobs cpp cpp17 distributed-computing redis redis-queue task-queue tasks worker-pool

Last synced: 13 Aug 2025

https://github.com/vardius/worker-pool

Go simple async worker pool

async worker-pool

Last synced: 17 Mar 2025

https://github.com/general-cbic/poolex

A library for managing pools of workers

elixir elixir-library hacktoberfest poolboy worker-pool

Last synced: 04 Apr 2025

https://github.com/hmdsefi/gowl

Gowl is a process management and process monitoring tool at once. An infinite worker pool gives you the ability to control the pool and processes and monitor their status.

concurrency concurrent-programming go golang monitor monitoring monitoring-tool pool pooling worker-pool

Last synced: 14 Mar 2025

https://github.com/dc0d/workerpool

A workerpool that can get expanded & shrink dynamically.

concurrency extra-workers go golang goroutine initial-workers pool worker-pool

Last synced: 12 Apr 2025

https://github.com/snuffydev/svelte-worker-store

:zap: Turbocharge your apps with multithreaded Svelte stores.

state stores svelte svelte-store sveltejs web-worker worker worker-pool worker-threads

Last synced: 02 May 2025

https://github.com/poolifier/poolifier-web-worker

Fast and small web worker pool

browser bun deno worker-pool

Last synced: 30 Apr 2025

https://github.com/g-andrade/taskforce

On-demand worker pools for parallelizable tasks

erlang parallelization worker-pool

Last synced: 13 Apr 2025

https://github.com/general-CbIC/poolex

A library for managing pools of workers

elixir elixir-library hacktoberfest poolboy worker-pool

Last synced: 14 May 2025

https://github.com/ankorstore/yokai-showroom

Showroom for demo applications based on the Yokai framework.

demo framework go golang grpc-server http-server worker-pool yokai

Last synced: 09 Oct 2025

https://github.com/joergen7/gruff

A basic worker pool manager for Erlang to showcase gen_pnet.

erlang petri-net poolboy worker-pool worker-pool-factory workers

Last synced: 10 Apr 2025

https://github.com/serpent7776/pg_worker_pool

Postgres extension creating a pool of background workers

c extension postgres postgresql worker worker-pool

Last synced: 14 Apr 2025

https://github.com/joergen7/cre

common runtime environment for distributed programming languages

distributed-computing erlang otp parallelization worker-pool

Last synced: 13 Jun 2025

https://github.com/attumm/meesee

Task queue, Long lived workers for work based parallelization, with processes and Redis as back-end. For distributed computing.

distributed distributed-computing python redis task-queue worker-pool workers

Last synced: 22 Aug 2025

https://github.com/yogain123/workers-pool

Workers Pooling in NodeJS

javascript nodejs worker-pool

Last synced: 13 Jun 2025

https://github.com/erlangpack/sidejob

Parallel, capacity-limited request pool

erlang worker-pool

Last synced: 04 Oct 2025

https://github.com/matthewoestreich/workerpoolxt

Concurrency limiting goroutine pool without upper limit on queue length. Extends github.com/gammazero/workerpool

concurrency multithreading worker-pool

Last synced: 19 Nov 2025

https://github.com/goadesign/pulse

โšกStreamlined event streaming and distributed worker pools in Goโšก

distributed-systems events go microservices streaming worker-pool workers

Last synced: 24 Dec 2025

https://github.com/utkusen/goroutine-benchmark

runs benchmarks to determine the optimal number of Go routine pool size on the current machine

go golang goroutine goroutine-pool worker-pool

Last synced: 07 May 2025

https://github.com/b1nary-gr0up/violin

VIOLIN worker/connection pool

connection-pool go worker-pool

Last synced: 29 Oct 2025

https://github.com/mstephen19/threadz

A feature rich and scalable general-purpose multi-threading library that makes it easy to utilize all of a given machine's resources in Node.js.

javascript multithreading nodejs thread threads typescript worker-pool worker-threads workers

Last synced: 13 Apr 2025

https://github.com/oresoftware/poolio

Node.js / NPM module for creating custom worker pools using child processes.

affinity-propagation child-process cluster nodejs npm pool worker-pool workers

Last synced: 18 Jun 2025

https://github.com/savsgio/workerpool

Lightweight and fast worker pool with generics support.

go golang tool utils worker-pool

Last synced: 02 Aug 2025

https://github.com/kc596/priorityworkerpool

A worker pool in GoLang which schedules job according to priority.

go golang golang-library goroutine goroutine-pool goroutinemanager goroutines worker-pool

Last synced: 19 Mar 2025

https://github.com/xizhibei/blackfyre

Distributed asynchronous task queue/job queue

amqp mongodb nodejs rabbitmq task-queue task-scheduler typescript worker-pool

Last synced: 13 Jul 2025

https://github.com/bnkamalesh/routinepool

A minimalistic Go package to setup a worker pool which accepts functions of signature `fn()` [not maintained]

go golang worker-pool worker-queue

Last synced: 31 Jul 2025

https://github.com/octu0/chanque

framework for asynchronous programming and goroutine management and safe use of channels

channel concurrency concurrent golang goroutine goroutine-management goroutine-pool parallel queue queue-workers worker-pool

Last synced: 12 Oct 2025

https://github.com/mix-php/worker-pool

Swoole-based worker pool, coroutine pool / ๅŸบไบŽ Swoole ็š„ๅทฅไฝœๆฑ ๏ผŒๅ็จ‹ๆฑ 

coroutine-pool pool worker-pool

Last synced: 21 Jun 2025

https://github.com/kevlened/threadwork

Simple, no frills, threading in Node.js

nodejs pool thread-pool threading worker-pool workers

Last synced: 08 Jul 2025

https://github.com/binarskugga/tentacule

Tentacule is an uncomplicated library to deal with a pool of worker processes

multiprocessing parallel pool process python streaming-data worker-pool workers

Last synced: 27 Oct 2025

https://github.com/damnever/workerpool

A handy and fast goroutine pool with a simple pipeline utility.

concurrent-programming golang goroutine-pool more-stack-issue worker-pool

Last synced: 01 Sep 2025

https://github.com/vasrem/gopp

Parallel processing functionality with configurable retry mechanism and error handling

go goroutine-pool worker-pool

Last synced: 21 Mar 2025

https://github.com/hqoss/pool_lad

๐Ÿ™…โ€โ™‚๏ธ The younger & more energetic version of :poolboy

elixir elixir-lang elixir-library pool poolboy worker-pool

Last synced: 12 Aug 2025

https://github.com/davidroman0o/retrypool

A powerful Go library for concurrent task processing with customizable retry logic and backoff strategies. Enhance your applications with robust and efficient worker pools that handle retries seamlessly.

backoff concurrency go golang pool resilience retry taskqueue tasks worker worker-pool worker-pools workerpool workers

Last synced: 12 Apr 2025

https://github.com/letiantech/worker

A lightweight worker framework for golang

golang job limiter worker worker-pool

Last synced: 28 Mar 2025

https://github.com/dc0d/spool

simple worker pool

go golang pool worker-pool workerpool workers

Last synced: 27 Dec 2025

https://github.com/prikhi/immortal-queue

Build a Queue-Processing Worker Pool using Immortal

asynchronous-tasks haskell immortal library pool queue-workers worker-pool workers

Last synced: 11 Jun 2025

https://github.com/miguelcastillo/workit

JavaScript utility for managing child processes in node

thread thread-pool worker worker-pool worker-queue

Last synced: 10 Apr 2025

https://github.com/harwoeck/ipstack

:satellite: ipstack is a helper package for calling the https://ipstack.com API. It includes type-safe response packets and a WorkerPool for asynchronous, once-only, lookup tasks.

asynchronous go golang helper ip ip-address ip-address-database ip-address-geolocation ip-address-lookup ipstack library package worker-pool

Last synced: 10 Apr 2025

https://github.com/jgardona/rpools

A minimalist rust workerpool implementation that uses channels to synchronize the jobs. It can spawn a fixed number of worker threads, that waits for a job queue.

concurrency library threadpool worker-pool

Last synced: 07 Oct 2025

https://github.com/coderaiser/node-thread-it

Wrap any sync module to thread worker

worker-pool workers

Last synced: 01 Jul 2025

https://github.com/phun-ky/hybrid-compute

Run compute tasks wherever they run best - local, threaded, or remote - with a pluggable backend architecture.

abstraction agent-tools ai api compute fetch framework hybrid llm modular multithreading offloading orchestration remote rpc serverless task-runner web-worker websocket worker-pool

Last synced: 29 Jun 2025

https://github.com/ankorstore/yokai-worker-template

Worker application template based on the Yokai Go framework.

dependency-injection framework go golang modular observability open-telemetry worker worker-pool yokai

Last synced: 23 Oct 2025

https://github.com/limpo1989/taskgo

taskgo is a lightweight task pool in Go

pool task-runner taskpool worker-pool

Last synced: 05 Apr 2025

https://github.com/jcbritobr/workerpool

A simple workerpool implementation in rust.

parallel rust threading worker-pool

Last synced: 06 Apr 2025

https://github.com/zekrotja/r34-crawler

A simple CLI tool to fetch and download images from rule34.xxx

crawler go rest-api rule34 worker-pool xml

Last synced: 17 Aug 2025

https://github.com/mohasarc/workers-pool

Utilizing the power of multithreading to process heavy tasks on nodejs

multithreading nodejs thread-pool worker-pool worker-threads

Last synced: 30 Oct 2025

https://github.com/gamaops/hfx-worker

A worker pool using NodeJS worker threads

ipc multithreading nodejs processing thread worker-pool

Last synced: 22 Mar 2025

https://github.com/egnd/go-toolbox

Monorepo for golang tools and helpers

config fb2 go golang graceful-shutdown logging telegram worker-pool xml-parser

Last synced: 27 Jul 2025

https://github.com/tcfw/go-queue

Chan based queue worker

channels go golang queues worker-pool

Last synced: 17 Jul 2025

https://github.com/pouchlabs/pqueue

A worker pool for bun,nodejs,browser,deno..run cpu intensive tasks in parallel.

browser bunjs nodejs queue worker worker-pool worker-threads

Last synced: 30 Aug 2025

https://github.com/janniclas/beehive

Beehive is a channel-based implementation of the Fan-Out and Fan-In pattern.

fan-out-fan-in pipeline worker-pool

Last synced: 07 May 2025

https://github.com/lapetitesouris/csvloader

Optimized CSV Loader, which replaces a traditional ETL process to load huge CSV dataset to traditional databases

dataengineering etl-job pattern worker-pool

Last synced: 03 Apr 2025

https://github.com/matthewoestreich/puddle

Puddle is a fork of `github.com/gammazero/workerpool` and meant for learning purposes.

concurrency golang golang-worker-pool multithreading worker-pool

Last synced: 15 Dec 2025

https://github.com/wangwilly/labs-gin

A Go-based API service for video downloading and processing using the Gin web framework.

backend docker docker-compose gin go golang restful-api worker-pool

Last synced: 18 Jun 2025

https://github.com/aoliveti/workerpool

A Go library that offers a minimalist solution for concurrent job execution using a worker pool.

go pool worker worker-pool

Last synced: 22 Jul 2025

https://github.com/luca-moser/pool

worker pool implementation for Go.

concurrency go golang parallelization worker-pool

Last synced: 27 Feb 2025

https://github.com/kamva/fangtooth

Fangtooth is a bootstrap for queue workers.

background-jobs job queue-workers worker-pool workers

Last synced: 28 Dec 2025

https://github.com/jiangz222/goworker

Lightweight and elegant GO worker pool

concurrency go golang wokers worker worker-pool

Last synced: 29 Mar 2025

https://github.com/jeamon/gofetching

Go source code to demonstrate three techniques for concurrent fetching of multiple urls over http.

concurrency concurrent-programming go golang goroutines http-client http-requests mutlithreading worker-pool

Last synced: 11 Mar 2025

https://github.com/patte/xstdin-rs

Like gnu xargs, but for stdin. Like gnu parallel, but keeps a set or workers running.

cli parallel rust worker-pool xargs

Last synced: 04 Dec 2025

https://github.com/zaidsasa/workerpool

Concurrency limiting goroutine pool

concurrency golang goroutine worker-pool

Last synced: 05 Apr 2025

https://github.com/kennykarnama/rabbitmq-worker-pool

Example of using worker pool when consume rabbitmq message

concurrency go golang-chan rabbitmq-example worker-pool

Last synced: 25 Jun 2025

https://github.com/nikhilbhatia08/taskflow

A distributed, durable job execution platform

background-jobs distributed go grpc task-queues worker-pool workflow-engine

Last synced: 15 Sep 2025

https://github.com/pixelcaliber/notification-service

Kafka Consumer loop a "worker" running infinitely and listening to kafka topic through long pooling

firebase flask-application kafka notification-service python3 socket-io worker-pool worker-threads

Last synced: 05 Mar 2025

https://github.com/izo0x90/pipeline-factory

Pipeline Factory is a Python server framework to define, manage, schedule and execute custom defined code pipelines and series of pipeline across multiple worker processes.

automation pipeline pipelines python python-framework server-framework task-runner task-scheduler tasks worker-pool workload

Last synced: 25 Jul 2025