https://github.com/tonytonyjan/benchmark-pulling-proxy

https://github.com/tonytonyjan/benchmark-pulling-proxy

Last synced: about 2 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/tonytonyjan/benchmark-pulling-proxy
• Owner: tonytonyjan
• Created: 2023-08-07T06:37:16.000Z (over 1 year ago)
• Default Branch: master
• Last Pushed: 2023-08-22T12:28:09.000Z (over 1 year ago)
• Last Synced: 2024-04-09T21:30:04.558Z (9 months ago)
• Language: Ruby
• Size: 5.86 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
This project aims to benchmark how a polling proxy server perform when forwarding reqeusts to another slow response server using IO multiplexing architecture.

## Start Server

```

docker-compose up --build

```

It starts 2 servers:

1. slow response server - with 20-second response time.

2. polling proxy - forwrad reqeust to slow response server and respond instantly with the the format in `{"state":"pending"}` or `{"state":"done"}`.

## Sequence Diagram

![](https://www.plantuml.com/plantuml/svg/jP8nQWCn44LxdMAOAW6dSAl26DO742Xz65iJ8w986sbinmJVFTAon5xOPelKy_xNuwDj4Sfo-WoA3f8oT405qAGGV3n25pn7GTLNnXzyJr70J0YJq_SLbIEXFHM6tN1zfV81jlRHaQTfEznjI1UmdC-SKQaENZPWDFoWrDoRTwZNj-RZpoGCHfa6x3HSiXT-6Y4DwnLKUs4Ds7DqLGUVxx6ToYod78Vq1go6p5ydBd97RBlLwgwzFLIX_gkwASTtXmMMcSazICuepJwtnCKsTB39NFeK2yC-kQi6V4y97s6xR4UN8kCAUhg6H6xicnjrulC_qumoECgWRZBpEysJKyajHrV_-Iy0)

## Usage

```sh

curl 'http://localhost:3000?task_id=123'

```

output for first time:

```

{"state":"pending"}

```

output after 20 seconds using the same `task_id`:

```

{"state":"done","result":"ok"}

```

## Benchmark

TL;DR: One single thread can handle approximately 2.5k concurrent clients.

Run the following command to benchmark:

```sh

./benchmark

```

example output:

```

Running 10s test @ http://polling-proxy:3000

  8 threads and 10000 connections

  Thread Stats   Avg      Stdev     Max   +/- Stdev

    Latency   280.47ms  117.21ms   1.70s    92.09%

    Req/Sec   362.93    419.94     2.02k    83.68%

  25179 requests in 10.09s, 2.72MB read

  Socket errors: connect 0, read 0, write 0, timeout 29

Requests/sec:   2494.44

Transfer/sec:    275.55KB

```