Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/filipecosta90/pubsub-bench
Estimate on how fast each Pub/Sub can process messages. Supports Redis pubsub and sharded pubsub
https://github.com/filipecosta90/pubsub-bench
pubsub redis
Last synced: 21 days ago
JSON representation
Estimate on how fast each Pub/Sub can process messages. Supports Redis pubsub and sharded pubsub
- Host: GitHub
- URL: https://github.com/filipecosta90/pubsub-bench
- Owner: filipecosta90
- License: apache-2.0
- Created: 2020-03-17T00:21:48.000Z (over 4 years ago)
- Default Branch: unstable
- Last Pushed: 2022-05-06T19:07:20.000Z (over 2 years ago)
- Last Synced: 2024-06-20T06:24:51.913Z (5 months ago)
- Topics: pubsub, redis
- Language: Go
- Homepage:
- Size: 89.8 KB
- Stars: 1
- Watchers: 4
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
## Overview
This tool is meant to provide a rough estimate on how fast each Pub/Sub can process messages.
When benchmarking a Pub/Sub Systems, we specifically require two distinct roles ( publishers and subscribers ) as benchmark participants - this repo contains code to mimic the publisher and subscriber workloads on Pub/Sub systems.
**Current Pub/Sub Systems supported**:
- Redis Pub/Sub
- Redis Sharded Pub/Sub (since Redis >= 7.0)
Several aspects can dictate the overall system performance, like the:
- Payload size (controlled on publisher)
- Number of Pub/Sub channels (controlled on publisher)
- Total message traffic per channel (controlled on publisher)
- Number of subscribers per channel (controlled on subscriber)
- Subscriber distribution per shard and channel (controlled on subscriber)
## Getting started with docker
### subscriber mode
```bash
docker run --network=host codeperf/pubsub-bench:unstable pubsub-bench subscribe
```
### publisher mode
```bash
docker run --network=host codeperf/pubsub-bench:unstable pubsub-bench publish
```
## Getting Started with prebuilt standalone binaries ( no Golang needed )
If you don't have go on your machine and just want to use the produced binaries you can download the following prebuilt bins:
| OS | Arch | Link |
| :--- | :---: | ---: |
| Linux | amd64 (64-bit X86) | [pubsub-bench-v0.1.0-linux-amd64.tar.gz](https://github.com/filipecosta90/pubsub-bench/releases/download/v0.1.0/pubsub-bench-v0.1.0-linux-amd64.tar.gz) |
| Linux | arm64 (64-bit ARM) | [pubsub-bench-v0.1.0-linux-arm64.tar.gz](https://github.com/filipecosta90/pubsub-bench/releases/download/v0.1.0/pubsub-bench-v0.1.0-linux-arm64.tar.gz) |
| Darwin | amd64 (64-bit X86) | [pubsub-bench-v0.1.0-darwin-amd64.tar.gz](https://github.com/filipecosta90/pubsub-bench/releases/download/v0.1.0/pubsub-bench-v0.1.0-darwin-amd64.tar.gz) |
| Darwin | arm64 (64-bit ARM) | [pubsub-bench-v0.1.0-darwin-arm64.tar.gz](https://github.com/filipecosta90/pubsub-bench/releases/download/v0.1.0/pubsub-bench-v0.1.0-darwin-arm64.tar.gz) |
Here's an example on how to use the above links for a linux based amd64 machine:
```bash
# Fetch it
wget -c https://github.com/filipecosta90/pubsub-bench/releases/download/v0.1.0/pubsub-bench-v0.1.0-linux-amd64.tar.gz -O - | tar -xz
# give it a try
./pubsub-bench subscribe --help
```
## Getting Started building from source
### Installing
This benchmark go program is **know to be supported for go >= 1.17**.
The easiest way to get and install the benchmark Go programs is to use `go get` and then `go install`:
```
go get github.com/filipecosta90/pubsub-sub-bench
cd $GOPATH/src/github.com/filipecosta90/pubsub-sub-bench
make
```