Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/alexgalhardo/learning-message-queue-and-pub-sub
Simple project I created with references and examples to learn about message queues and publisher/subscriber pattern with different technologies.
https://github.com/alexgalhardo/learning-message-queue-and-pub-sub
aws-dynamodb aws-s3 aws-sns aws-sqs bullmq docker docker-compose localstack pubsub rabbitmq redis typescript
Last synced: 13 days ago
JSON representation
Simple project I created with references and examples to learn about message queues and publisher/subscriber pattern with different technologies.
- Host: GitHub
- URL: https://github.com/alexgalhardo/learning-message-queue-and-pub-sub
- Owner: AlexGalhardo
- Created: 2024-06-21T03:25:23.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2024-08-17T12:04:39.000Z (5 months ago)
- Last Synced: 2025-01-03T05:33:24.823Z (18 days ago)
- Topics: aws-dynamodb, aws-s3, aws-sns, aws-sqs, bullmq, docker, docker-compose, localstack, pubsub, rabbitmq, redis, typescript
- Language: TypeScript
- Homepage:
- Size: 99.6 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
Learning Message Queues & Pub Sub
## Introduction
- Simple project I created with references and examples to learn about message queues and publisher/subscriber pattern with different technologies.
## To Do
- [x] [RabbitMQ](https://www.rabbitmq.com/) Message Queue Example
- [x] [RabbitMQ](https://www.rabbitmq.com/) PubSub Example
- [x] [Apache Kafka](https://kafka.apache.org/) Message Queue Example
- [x] [Apache Kafka](https://kafka.apache.org/) PubSub Example
- [x] [Observer Pattern](https://refactoring.guru/design-patterns/observer) (GoF) Example
- [x] [BullMQ](https://bullmq.io/) Message Queue Example
- [x] [AWS SQS](https://aws.amazon.com/sqs/) Example using LocalStack
- [x] [AWS SNS](https://aws.amazon.com/sns/) Example using LocalStack
- [x] [AWS S3](https://aws.amazon.com/pm/serv-s3/) Example using LocalStack
- [x] [AWS Dynamodb](https://aws.amazon.com/pm/dynamodb/) Example using LocalStack
## Prerequisites
- Install Bun:
- Install LocalStack:
- Install Docker & Docker-Compose:
a. Install dependencies & up docker-compose
```bash
sudo chmod +x setup.sh && ./setup.sh
```
b. To see RabbitMQ Management UI, go to:
- Username: `guest`
- Password: `guest`
c. To see LocalStack UI, go to:
## Observer Pattern Example
- Credits:
1. Run script
```bash
bun run observer-pattern
```
## RabbitMQ Message Queue Example
1. Run producer (send message)
```bash
bun run rabbitmq-queue-producer
```
2. Run consumer (consume message)
```bash
bun run rabbitmq-queue-consumer
```
## RabbitMQ PubSub Example
1. Run subscriber to stay listening... (receive notifications in subscriber)
```bash
bun run rabbitmq-pubsub-subscriber
```
2. Run publish (publish message to subscribers consume)
```bash
bun run rabbitmq-pubsub-publisher
```
## Apache Kafka Message Queue Example
1. Run producer (send messages)
```bash
bun run apache-kafka-queue-producer
```
2. Run consumer (consume messages)
```bash
bun run apache-kafka-queue-consumer
```
## Apache Kafka PubSub Example
1. Run publisher (send messages to topic x)
```bash
bun run apache-kafka-pubsub-publisher
```
2. Run subscriber (subscribers consume messages from topic x)
```bash
bun run apache-kafka-pubsub-subscriber
```
## BullMQ Message Queue Example
1. Run job
```bash
bun run bullmq-mq-job
```
2. Run worker
```bash
bun run bullmq-mq-worker
```
## AWS SQS Example
### CLI
- Prerequisites
- Install AWS CLI:
- Verify your AWS Credentials:
```bash
aws --version
export AWS_ACCESS_KEY_ID="test"
export AWS_SECRET_ACCESS_KEY="test"
export AWS_DEFAULT_REGION="us-east-1"
aws configure --profile localstack
aws configure list
```
1. Creating QUEUE
```bash
aws sqs create-queue --endpoint-url http://localhost:4566 --queue-name cli-test-queue --profile localstack
```
2. Listing QUEUEs
```bash
aws sqs list-queues --endpoint-url http://localhost:4566 --profile localstack
```
3. Sending Messages
```bash
aws sqs send-message --endpoint-url http://localhost:4566 --queue-url http://localhost:4566/000000000000/cli-test-queue --message-body "Testing Message" --message-attributes file://./src/aws-sqs/message.json --profile localstack
```
4. Receiving Messages
```bash
aws sqs receive-message --endpoint-url http://localhost:4566 --queue-url http://localhost:4566/000000000000/cli-test-queue --attribute-names All --message-attribute-names All --profile localstack
```
### Code
1. Run example
```bash
bun run aws-sqs-example
```
## AWS SNS Example
1. Run example
```bash
bun run aws-sns-example
```
## AWS S3 Example
1. Run example
```bash
bun run aws-s3-example
```
## AWS Dynamodb Example
1. Run example
```bash
bun run aws-dynamodb-example
```
## Images Example
## License
[MIT](http://opensource.org/licenses/MIT)
Copyright (c) June 2024-present, [Alex Galhardo](https://github.com/AlexGalhardo)