Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/tonyhb/awesome-queues-jobs-and-tasks

A curated list of awesome queueing systems for background jobs and distributed tasks.
https://github.com/tonyhb/awesome-queues-jobs-and-tasks

List: awesome-queues-jobs-and-tasks

Last synced: 6 days ago
JSON representation

A curated list of awesome queueing systems for background jobs and distributed tasks.

Host: GitHub
URL: https://github.com/tonyhb/awesome-queues-jobs-and-tasks
Owner: tonyhb
License: cc0-1.0
Created: 2022-06-09T19:00:12.000Z (over 2 years ago)
Default Branch: main
Last Pushed: 2023-03-22T04:22:13.000Z (over 1 year ago)
Last Synced: 2024-05-20T23:25:16.747Z (6 months ago)
Size: 10.7 KB
Stars: 12
Watchers: 2
Forks: 2
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

awesome-temporal - Queues

README

        




        Awesome Queues





        





        A curated list of awesome queueing systems for background jobs and distributed tasks.











Queues allow you to create reliable distributed background tasks - logic that runs in the background, separate from your main request.









### Serverless queues

- [Inngest](https://github.com/inngest/inngest-cli) - An event-driven serverless queue, in which serverless functions are triggered by HTTP events.

- [SQS](https://aws.amazon.com/sqs/) - A cloud message queue from AWS, supporting Lambda functions

### Language-agnostic queues

- [SQS](https://aws.amazon.com/sqs/) - A cloud message queue from AWS.  Supports elastic scale, and delaying jobs up to 15m ahead of time.

- [Inngest](https://github.com/inngest/inngest-cli) - An event-driven queue, running serverless functions in any language

- [Faktory](https://github.com/contribsys/faktory) - A self-hosted distributed task queue written in Go, with SDKs available for many languages

- [Temporal](https://temporal.io/) - A durable execution system: reliable, automatic queueing that handles high scale.

### Language-specific queues

#### Python queues

- [Celery](https://github.com/celery/celery), a commonly used distributed task queue written in Python

- [RQ](https://github.com/rq/rq), a simple task queue for Python backed by Redis

#### Go queues

- [Tasqueue](https://github.com/kalbhor/Tasqueue) - A task queue service backed by Redis or NATS.  It supports cron, but not delayed jobs.

- [Asynq](https://github.com/hibiken/asynq) - A task queue service backed by Redis.

#### Ruby queues

- [Sidekiq](https://github.com/mperham/sidekiq) - A very common background task runner for Ruby, backed by Redis.

#### JavaScript, TypeScript, and NodeJS queues

- [BullMQ](https://github.com/taskforcesh/bullmq) - A message queue for NodeJS backed by redis