https://github.com/tonyhb/awesome-queues-jobs-and-tasks

A curated list of awesome queueing systems for background jobs and distributed tasks.
https://github.com/tonyhb/awesome-queues-jobs-and-tasks

List: awesome-queues-jobs-and-tasks

Last synced: 4 months ago
JSON representation

A curated list of awesome queueing systems for background jobs and distributed tasks.

• Host: GitHub
• URL: https://github.com/tonyhb/awesome-queues-jobs-and-tasks
• Owner: tonyhb
• License: cc0-1.0
• Created: 2022-06-09T19:00:12.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2023-03-22T04:22:13.000Z (over 1 year ago)
• Last Synced: 2024-03-12T20:02:42.733Z (4 months ago)
• Size: 10.7 KB
• Stars: 11
• Watchers: 2
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Lists

• awesome-temporal - Queues

README

        




        Awesome Queues





        





        A curated list of awesome queueing systems for background jobs and distributed tasks.











Queues allow you to create reliable distributed background tasks - logic that runs in the background, separate from your main request.









### Serverless queues

- [Inngest](https://github.com/inngest/inngest-cli) - An event-driven serverless queue, in which serverless functions are triggered by HTTP events.

- [SQS](https://aws.amazon.com/sqs/) - A cloud message queue from AWS, supporting Lambda functions

### Language-agnostic queues

- [SQS](https://aws.amazon.com/sqs/) - A cloud message queue from AWS.  Supports elastic scale, and delaying jobs up to 15m ahead of time.

- [Inngest](https://github.com/inngest/inngest-cli) - An event-driven queue, running serverless functions in any language

- [Faktory](https://github.com/contribsys/faktory) - A self-hosted distributed task queue written in Go, with SDKs available for many languages

- [Temporal](https://temporal.io/) - A durable execution system: reliable, automatic queueing that handles high scale.

### Language-specific queues

#### Python queues

- [Celery](https://github.com/celery/celery), a commonly used distributed task queue written in Python

- [RQ](https://github.com/rq/rq), a simple task queue for Python backed by Redis

#### Go queues

- [Tasqueue](https://github.com/kalbhor/Tasqueue) - A task queue service backed by Redis or NATS.  It supports cron, but not delayed jobs.

- [Asynq](https://github.com/hibiken/asynq) - A task queue service backed by Redis.

#### Ruby queues

- [Sidekiq](https://github.com/mperham/sidekiq) - A very common background task runner for Ruby, backed by Redis.

#### JavaScript, TypeScript, and NodeJS queues

- [BullMQ](https://github.com/taskforcesh/bullmq) - A message queue for NodeJS backed by redis