Projects in Awesome Lists tagged with task-queue

https://github.com/hibiken/asynq

Simple, reliable, and efficient distributed task queue in Go

asynchronous-tasks background-jobs go golang redis task-queue worker-pool

Last synced: 12 May 2025

https://github.com/rq/rq

Simple job queues for Python

async background-jobs delayed-jobs delayed-tasks job-queue python redis rq task task-queue workers

Last synced: 12 May 2025

https://github.com/mher/flower

Real-time monitor and web admin for Celery distributed task queue

administration asynchronous celery monitoring python rabbitmq redis task-queue workers

Last synced: 13 May 2025

https://github.com/coleifer/huey

a little task queue for python

dank python queue redis task-queue

Last synced: 13 May 2025

https://github.com/rq/django-rq

A simple app that provides django integration for RQ (Redis Queue)

background-jobs django job-queue python redis rq task-queue

Last synced: 11 May 2025

https://github.com/vmihailenco/taskq

Golang asynchronous task/job queue with Redis, SQS, IronMQ, and in-memory backends

go golang ironmq ironmq-backend message-queue queue redis sqs task-queue taskqueue

Last synced: 11 Apr 2025

https://github.com/procrastinate-org/procrastinate

PostgreSQL-based Task Queue for Python

async postgresql python sync task-queue

Last synced: 10 Apr 2025

https://github.com/quirrel-dev/quirrel

The Task Queueing Solution for Serverless.

quirrel serverless task-queue typescript

Last synced: 14 May 2025

https://github.com/bitleak/lmstfy

A task queue with REST API

redis redis-lua task-queue

Last synced: 15 Mar 2025

https://github.com/wakatime/wakaq

Background task queue for Python backed by Redis, a super minimal Celery

async asynchronous-tasks background-jobs celery distributed job-queue job-scheduler python queue redis rq task-queue task-queues worker

Last synced: 13 Apr 2025

https://github.com/runabol/tork

A distributed workflow engine

background-jobs distributed docker go golang job-queue task-queue work-queue workflow-engine

Last synced: 04 Apr 2025

https://github.com/testdrivenio/fastapi-celery

Example of how to handle background processes with FastAPI, Celery, and Docker

fastapi fastapi-celery fastapi-docker task-queue

Last synced: 04 Apr 2025

https://github.com/django-q2/django-q2

A multiprocessing distributed task queue for Django based on Django-Q

django task-queue

Last synced: 16 Apr 2025

https://github.com/cadence-workflow/cadence-go-client

Framework for authoring workflows and activities running on top of the Cadence orchestration engine.

authoring-workflows aws-swf cadence golang orchestration-engine task-management task-queue workflow-functions

Last synced: 15 Apr 2025

https://github.com/JoseTomasTocino/yotaq

yotaq - Your Own Task Queue for Python

python task-queue task-runner

Last synced: 29 Mar 2025

https://github.com/xiyuan-fengyu/ppspider

web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb），提供数据可视化和用户交互的实现方案

angular cheerio crawler headless mongodb nedb node node-spider nodejs nodejs-spider proxy puppeteer spider task-queue task-scheduling typescript

Last synced: 05 Apr 2025

https://github.com/acaloiaro/neoq

Queue-agnostic background job library for Go, with a pleasant API and powerful features.

async asynchronous-tasks background-jobs distributed-systems golang postgres task-queue worker-pool worker-pool-go

Last synced: 13 May 2025

https://github.com/actumn/celery.node

Celery task queue client/worker for nodejs

amqp background background-jobs celery celery-client celery-protocol celery-workers job-queue queue queue-workers queued-jobs task-manager task-queue task-runner worker worker-queue workers

Last synced: 27 Mar 2025

https://github.com/mjhea0/flask-redis-queue

Example of how to handle background processes with Flask, Redis Queue, and Docker

docker flask redis task-queue

Last synced: 21 Jun 2025

https://github.com/cnstark/gputasker

An awesome gpu tasks scheduler. 轻量好用的GPU机群任务调度工具。觉得有用可以点个star

deep-learning django gpu gpu-monitoring gpustat nvidia nvidia-gpu task-manager task-queue task-scheduler

Last synced: 25 Jan 2025

https://github.com/eXascaleInfolab/PyExPool

Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture

application-framework benchmarking-framework cache-control execution-pool in-memory-computations load-balancing monitoring-server multiprocessing numa parallel-computing parallel-processing task-queue

Last synced: 02 Apr 2025

https://github.com/cadence-workflow/cadence-java-client

Java framework for Cadence Workflow Service

aws-swf cadence cadence-client task-management task-management-system task-queue task-scheduler uber workflow-engine workflow-management-system workflow-scheduler

Last synced: 05 May 2025

https://github.com/django-commons/django-tasks-scheduler

Schedule async tasks using redis protocol. Redis/ValKey/Dragonfly or any broker using the redis protocol can be used.

background-jobs django django-application job-queue python redis scheduled-jobs scheduled-tasks task-queue valkey

Last synced: 16 May 2025

https://github.com/vintasoftware/celery-tasks-checklist

Useful checklist for building great Celery tasks.

async-task celery-task task-queue

Last synced: 13 Mar 2025

https://github.com/erdewit/distex

Distributed process pool for Python

asyncio distributed-computing multiprocessing parallel-computing python task-queue

Last synced: 26 Mar 2025

https://github.com/hyperonym/ratus

Ratus is a RESTful asynchronous task queue server. It translated concepts of distributed task queues into a set of resources that conform to REST principles and provides a consistent HTTP API for various backends.

background-jobs distributed-systems go golang mongodb priority-queue restful-api swagger task task-queue task-scheduler

Last synced: 14 Mar 2025

https://github.com/choria-io/asyncjobs

Asynchronous Job Processor

asynchronous go golang jetstream jobs nats queues scheduler scheduling task-queue worker-pool

Last synced: 14 Apr 2025

https://github.com/h2337/cppq

Simple, reliable & efficient distributed task queue for C++17

asynchronous-tasks background-jobs cpp cpp17 distributed-computing redis redis-queue task-queue tasks worker-pool

Last synced: 30 Apr 2025

https://github.com/dumbmachine/nq

Cancellable, Efficient and Reliable Distributed Task Queue in Go

asynchronous-tasks background-jobs go golang nats task-queue worker-queue

Last synced: 05 Apr 2025

https://github.com/joegasewicz/pytask-io

Python Async Task Queue

asyncio coroutines redis task-manager task-queue wsgi

Last synced: 06 Apr 2025

https://github.com/codepr/tasq

A simple task queue implementation to enqeue jobs on local or remote processes.

distributed-computing distributed-job distributed-systems job-scheduler queue redis remote-workers scheduled-jobs task-queue zmq

Last synced: 27 Nov 2024

https://github.com/nvdv/atq

distributed task queue for asyncio

async-await asyncio python python3 task-queue

Last synced: 15 Apr 2025

https://github.com/celery/celery-kubernetes-operator

An operator to manage celery clusters on Kubernetes (Work in Progress)

celery-operator celery-workers flower-deployment kubernetes kubernetes-operator task-queue

Last synced: 13 Apr 2025

https://github.com/mikestefanello/backlite

Type-safe, persistent, embedded task queues and background job runner w/ SQLite

go golang job-queue job-scheduler jobs queue queues scheduled-tasks sqlite sqlite3 task task-manager task-queue task-runner tasks

Last synced: 09 Apr 2025

https://github.com/p-ranav/psched

Priority-based Task Scheduling for Modern C++

aging concurrency cpp17 header-only lightweight mit-license priority priority-modulation priority-scheduling queue queueing scheduling single-header single-header-lib task-management task-parallelism task-queue task-scheduler task-starvation threading

Last synced: 05 May 2025

https://github.com/chris104957/django-carrot

A lightweight task queue for Django using RabbitMQ

asynchronous-tasks django django-carrot pika python3 rabbitmq task-queue

Last synced: 19 Dec 2024

https://github.com/agungdwiprasetyo/backend-microservices

Monorepo for backend microservices golang

abstract-factory-pattern backend backend-microservices clean-architecture codebase continuous-integration cronjob-scheduler golang graphql grpc kafka-consumer monorepo redis-pubsub rest-api task-queue

Last synced: 14 Apr 2025

https://github.com/testdrivenio/simple-task-queue

asynchronous task queues using python's multiprocessing library

multiprocessing python redis task-queue

Last synced: 25 Nov 2024

https://github.com/mugli/orkid-node

Reliable and modern Redis Streams based task queue for Node.js 🤖

javascript job job-queue job-scheduler message-queue node-js nodejs nodejs-library orkid queue redis redis-queue redis-stream redis-streams task-queue task-scheduler typescript typescript-definitions typescript-library worker-queue

Last synced: 07 Apr 2025

https://github.com/jgujerry/python-frameworks

Another curated list of Python frameworks

api artificial-intelligence cms data-workflow deep-learning devops distributed-computing enterprise-integrations frameworks machine-learning messaging parallel-computing pipeline python task-queue web-crawling webapp

Last synced: 26 Mar 2025

https://github.com/cihga39871/jobschedulers.jl

A Julia-based job scheduler and workload manager inspired by Slurm, PBS and Crontab.

cron crontab job-queue job-scheduler julia pbs pipeline pipelines queue scheduled-tasks scheduler slurm task-management task-manager task-queue task-scheduler workflow workload workload-managers

Last synced: 16 Mar 2025

https://github.com/loveleshsharma/gohive

🐝 A Highly Performant and easy to use goroutine pool for Go

async asynchronous-tasks concurren go goroutine goroutine-pool goroutine-scheduling pool task-queue task-scheduler

Last synced: 14 Mar 2025

https://github.com/conveyor-mq/conveyor-mq

A fast, robust and extensible distributed task/job queue for Node.js, powered by Redis.

distributed job job-queue job-scheduler jobs node nodejs queue redis task task-queue task-scheduler worker worker-queue

Last synced: 06 Dec 2024

https://github.com/abraham-ai/eden

Eden converts your python function into a hosted endpoint with minimal changes to your existing code :mage_man:

celery cuda fastapi python redis-client task-queue

Last synced: 08 Feb 2025

https://github.com/alugowski/task-thread-pool

Fast and lightweight thread pool for C++11 and newer.

async asynchronous asynchronous-programming asynchronous-tasks concurrency concurrent-programming cpp11 cpp14 cpp17 cpp20 cpp23 multithreading parallel task-queue task-runner thread-pool threadpool threads

Last synced: 10 Apr 2025

https://github.com/samrith-s/concurrent-tasks

A simple task runner which will run all tasks till completion, while maintaining concurrency limits.

concurrent-tasks javascript priority-queue task task-list task-queue task-runner tasks

Last synced: 21 Mar 2025

https://github.com/dymmond/asyncmq

Supercharge your async applications with tasks so fast, you’ll think you’re bending time itself.

anyio asyncio background-jobs celery-alternative concurrency dead-letter-queue esmerald fastapi job-scheduler message-queue microservices mongodb paralelism postgres postgresql python rate-limiter redis retry-policy task-queue

Last synced: 13 May 2025

https://github.com/justplainstuff/plainjob

SQLite-backed job queue processing 15k jobs/s

better-sqlite3 bun job-queue jobs queue sqlite task-queue typescript

Last synced: 10 Apr 2025

https://github.com/clivern/chunk

🐺 Asynchronous Task Queue Based on Distributed Message Passing for PHP.

async chunk clivern hacktoberfest php-async php-sdk queue rabbitmq task-queue

Last synced: 07 Apr 2025

https://github.com/testdrivenio/falcon-celery

Example of how to handle background processes with Falcon, Celery, and Docker

celery docker falcon falcon-framework task-queue

Last synced: 25 Nov 2024

https://github.com/lyrictian/queue

A task queue library for Go.

go-queue go-task-queue queue task-queue

Last synced: 15 Apr 2025

https://github.com/zhashkevych/musicload-bot

Telegram Bot written in Go

bot docker go golang pubsub task-queue telegram telegram-bot telegram-bot-api

Last synced: 28 Apr 2025

https://github.com/flouthoc/buha.js

Browser based Strictly ordered Task Queue for Sync/Async Javascript Functions

async-await asynchronous-tasks javascript job-queue sync task-queue

Last synced: 22 Mar 2025

https://github.com/wakatime/wakaq-ts

Background task queue for TypeScript backed by Redis, a super minimal Celery

async asyncronous-tasks background-jobs celery distributed job-queue job-scheduler queue redis rq task-queue task-queues typescript worker

Last synced: 09 Apr 2025

https://github.com/giacbrd/smartpipeline

A framework for rapid development of robust data pipelines following a simple design pattern

data-analysis data-analytics data-mining data-pipelines data-processing data-science dataops design-patterns etl machine-learning mlops pipeline pipeline-framework pipelines reproducibility task-queue workflow

Last synced: 21 Mar 2025

https://github.com/pjcunningham/flask-huey-example

Example of setting up Flask with the Huey task queue

flask huey python task-queue

Last synced: 12 May 2025

https://github.com/luocfprime/labtasker

Experiment task scheduling made easy.

machine-learning mongodb-database python3 task-manager task-queue task-scheduler workflow-automation

Last synced: 02 Apr 2025

https://github.com/xadillax/scarlet-task

Scarlet Task is an advanced task queue module for Node.js, featuring the ability to configure multiple child queues for a single task queue.

flandre-scarlet task-queue

Last synced: 14 Apr 2025

https://github.com/fkcptlst/labtasker

Experiment task scheduling made easy.

machine-learning mongodb-database python3 task-manager task-queue task-scheduler workflow-automation

Last synced: 24 Mar 2025

https://github.com/grimmerk/d4c-queue

Execute tasks sequentially or concurrently. Wrap an async/promise-returning/sync function as a queue-ready async function for easy reusing. Support passing arguments/getting return value, decorators. below is an introduction to v1.6.

apollo await browser concurency concurrency decorators javascript lock nestjs nodejs promise-returning-functions sequential synchronization task-queue throttle typescript

Last synced: 03 Apr 2025

https://github.com/attumm/meesee

Task queue, Long lived workers for work based parallelization, with processes and Redis as back-end. For distributed computing.

distributed distributed-computing python redis task-queue worker-pool workers

Last synced: 20 Dec 2024

https://github.com/launchplatform/bq

BeanQueue, a lightweight Python task queue framework based on SQLAlchemy, PostgreSQL SKIP LOCKED queries and NOTIFY / LISTEN statements.

postgresql python queue sqlalchemy task-queue worker

Last synced: 12 Apr 2025

https://github.com/allenling/magne

Curio, RabbitMQ, Distributed Task Queue(celery)

asynchronous-io curio python3 task-queue task-worker

Last synced: 29 Jan 2025

https://github.com/hoangsonww/the-ultimate-task-board

📋 A dynamic tool that allows users to display and organize tasks on a virtual board. It offers an intuitive interface for task management, supporting various types of tasks and customization options. Ideal for individuals and teams looking for an efficient way to manage projects and daily activities!

css fullstack-development html machine-learning task task-board task-list task-manager task-queue task-scheduler tasks taskscheduler vanilla-js

Last synced: 20 Jun 2025

https://github.com/verumlotus/nft-batch-download

Batch download images from an NFT collection

celery docker ethereum fastapi ipfs logtail nft prisma python3 redis s3 task-queue

Last synced: 10 Apr 2025

https://github.com/justrach/kew

🚀 Kew - A Fast, Redis-backed Task Queue Manager for Python

async asyncio circuit-breaker distrubuted-systems priority-queue python python-library queue-management redis task-queue

Last synced: 22 Apr 2025

https://github.com/insipx/coil

Futures-based background work queue built with SQLx and Postgres

async-await async-std asyncronous-jobs job-queue postgres rust smol sqlx task-queue tokio

Last synced: 09 Apr 2025

https://github.com/peterfraedrich/consulmq

Use k/v stores as message queues!

consul-kv filesystem golang in-memory kubernetes message-queue redis task-queue

Last synced: 22 Apr 2025

https://github.com/pwwang/xqute

A job management system for python

job-queue job-scheduler queue-tasks queue-workers task-management task-manager task-queue task-runner task-scheduler

Last synced: 29 Apr 2025

https://github.com/calebboyd/redis-x-stream

An AsyncIterable interface for reading redis streams

async consumer iterable javascript job-queue nodejs nodejs-library queue redis redis-queue streams task-queue typescript typescript-library worker-queue

Last synced: 20 Apr 2025

https://github.com/shuo-s-feng/taskon

A simple javascript/typesciprt tasks queue that supports concurrency control, designed by Shuo Feng

asynchronous concurrency javascript task-queue typescript

Last synced: 12 Jan 2025

https://github.com/muellan/parallel

parallel programming primitives for C++; pausable thread, task_queue, etc.

cpp cpp11 parallel parallel-programming-primitives task-queue threadpool

Last synced: 19 Apr 2025

https://github.com/mugli/orkid-ui

Dashboard to monitor and manage Orkid task queue ✨

dashboard job-queue monitoring nodejs orkid queue-manager task-queue

Last synced: 07 Apr 2025

https://github.com/flix-tech/redis-tq

redis-based task queue written in Python

python redis task-queue

Last synced: 10 Apr 2025

https://github.com/pods-framework/pods-jobs-queue

Queue callbacks to be ran with arguments, unlike wp_cron which is scheduled jobs, these are queued and run concurrently as needed

pods pods-addon task-queue wordpress-plugin

Last synced: 05 May 2025

https://github.com/mugli/orkid-api

GraphQL API to monitor and manage Orkid task queue ⚙️

graphql graphql-api job-queue monitoring nodejs orkid queue queue-manager redis task-queue

Last synced: 12 Feb 2025

https://github.com/nekomeowww/timecapsule

A Redis based task scheduling module written in Golang.

delayed-job delayed-queue delayed-tasks golang-library redis task-queue task-scheduler

Last synced: 24 Jan 2025

https://github.com/basis-company/sharded-queue.py

strict order sharded job queue

jobqueue priority priority-queue python queue redis sharded sharding task-queue

Last synced: 24 Apr 2025

https://github.com/soft/process-queue

Command-line task queue

command-line process-manager queue rust server task-queue utility work-queue

Last synced: 30 Apr 2025

https://github.com/mshick/hapi-rabbitmq

A HAPI server plugin exposing RabbitMQ-backed PubSub and task queue pattern methods from librabbitmq.

amqp hapi pubsub rabbitmq task-queue

Last synced: 13 Jan 2025

https://github.com/joakin/task-queue

A customizable job/task queue for javascript processes.

concurrency nodejs queue task task-queue typescript

Last synced: 18 Mar 2025

https://github.com/xizhibei/blackfyre

Distributed asynchronous task queue/job queue

amqp mongodb nodejs rabbitmq task-queue task-scheduler typescript worker-pool

Last synced: 17 Feb 2025

https://github.com/theonethread/falkor-commander

Falkor operations commander

automation cli commander falkor operations runner sequencer task task-queue task-runner task-sequence

Last synced: 22 Nov 2024

https://github.com/taskcontrols/py-taskcontrol

Control, Create, Run named workflows & tasks with before/after middlewares support, data persistence, orm, authentication, logging, multi-threading/processing, events, network sockets, webhooks, client-agent libraries, etc with plugins support [Actively Developed, Funding Invited] - pip3 install taskcontrol https://pypi.org/project/taskcontrol

aws aws-devops azure azure-devops devops devops-tools gcp middlewares python python2 python3 task-queue task-runner workflow-automation workflow-tool workflows

Last synced: 13 Apr 2025

https://github.com/taskcontrols/js-taskcontrol

Control, Create, Run named workflows & tasks with before/after middlewares support, data persistence, orm, authentication, logging, multi-threading/processing, events, network sockets, webhooks, client-agent libraries, etc with plugins support [Actively Developed, Funding invited] - npm install taskcontrol https://www.npmjs.com/package/taskcontrol

aws aws-devops azure azure-devops devops devops-tools gcp middlewares nodejs serverless task-queue task-runner typescript workflow-automation workflow-tool workflows