https://github.com/luislavena/bench-micro
Benchmark some Ruby web microframeworks, just for fun
https://github.com/luislavena/bench-micro
Last synced: 11 months ago
JSON representation
Benchmark some Ruby web microframeworks, just for fun
- Host: GitHub
- URL: https://github.com/luislavena/bench-micro
- Owner: luislavena
- Created: 2013-11-28T13:26:43.000Z (over 12 years ago)
- Default Branch: master
- Last Pushed: 2022-12-14T08:19:00.000Z (about 3 years ago)
- Last Synced: 2025-03-31T18:19:36.621Z (11 months ago)
- Language: Ruby
- Size: 140 KB
- Stars: 245
- Watchers: 12
- Forks: 30
- Open Issues: 9
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-ruby-performance - Benchmark some Ruby web microframeworks, just for fun
README
# bench some web microframeworks (Ruby)
Because we don't have enough drama, let's bench some *hello world* apps!
## Why?
As part of some research, collected some benchmark around Ruby web
microframeworks.
The idea is bench the performance from [Rack](https://github.com/rack/rack),
throught the stack of the framework to the minimum representation of an
application (*Hello World* apps).
It is not the goal to bechmark hits to the database or external services,
nor to do a silly *fibonacci-as-a-service*, ok?
## What?
Rack 2 compatible frameworks
- [Cuba](https://github.com/soveran/cuba) - [cuba.ru](apps/cuba.ru)
- [Flame](https://github.com/AlexWayfer/flame) - [flame.ru](apps/flame.ru)
- [Grape](https://github.com/ruby-grape/grape) - [grape.ru](apps/grape.ru)
- [Hanami (Router)](https://github.com/hanami/router) - [hanami-router.ru](apps/hanami-router.ru)
- [Hobbit](https://github.com/patriciomacadden/hobbit) - [hobbit.ru](apps/hobbit.ru)
- [Hobby](https://github.com/ch1c0t/hobby) - [hobby.ru](apps/hobby.ru)
- [Newark](https://github.com/mje113/newark) - [newark.ru](apps/newark.ru)
- [Plezi](https://github.com/boazsegev/plezi) - [plezi.ru](apps/plezi.ru)
- [Rack](https://github.com/rack/rack) - [rack.ru](apps/rack.ru) + [rack-response.ru](apps/rack-response.ru)
- [Rack-App](https://github.com/rack-app/rack-app) - [rack-app.ru](apps/rack-app.ru)
- [RackStep](https://github.com/mfdavid/rackstep) - [rackstep.ru](apps/rackstep.ru)
- [Rails (API + Metal)](https://github.com/rails/rails) - [rails-api.ru](apps/rails-api.ru) + [rails-metal.ru](apps/rails-metal.ru)
- [Rambutan](https://github.com/NewRosies/rambutan) - [rambutan.ru](apps/rambutan.ru)
- [Roda](https://github.com/jeremyevans/roda) - [roda.ru](apps/roda.ru)
- [Sinatra](https://github.com/sinatra/sinatra) - [sinatra.ru](apps/sinatra.ru)
- [Syro](https://github.com/soveran/syro) - [syro](apps/syro.ru)
- [Watts](https://github.com/pete/watts) - [watts](apps/watts.ru)
Please note that while Rails has been added to the list, it is just a
minimalistic representation with ActionPack gem (using API and Metal, no full middleware stack, etc). You
shouldn't take the performance numbers mentioned here about Rails (or any
other) as scientific and decision-taking references.
## How?
Used [wrk](https://github.com/wg/wrk) to benchmark, locally, a burst of
requests (in 2 threads) over 10 seconds. The command line used was:
```console
$ wrk -t 2 http://localhost:9292/
```
All the frameworks using [Puma](https://github.com/puma/puma) on
Ruby 2.4, in production mode with 16 threads:
```console
$ puma -e production -t 16:16 apps/
```
## Run benchmark for all frameworks
```console
# use `bundle exec`, if needed
$ bench/summary-memory
$ bench/summary-speed
```
### Have some numbers around?
Yup, I do:
#### Requests/sec
```
Framework Requests/sec % from best
----------------------------------------------
rack 15839.64 100.00%
watts 13585.65 85.77%
syro 13306.01 84.00%
roda 11776.27 74.35%
cuba 11501.96 72.62%
rack-response 11480.11 72.48%
hobbit 11140.22 70.33%
hobby 10606.80 66.96%
hanami-router 10247.61 64.70%
newark 8896.35 56.17%
rambutan 8466.83 53.45%
plezi 8240.07 52.02%
rackstep 8187.32 51.69%
rack-app 7473.52 47.18%
rails-metal 6598.65 41.66%
flame 5454.46 34.44%
sinatra 3977.30 25.11%
grape 2937.03 18.54%
rails-api 1211.33 7.65%
```
#### Memory Allocation/Request
```
Framework Allocs/Req Memsize/Req
--------------------------------------
rack 41 2920
roda 45 3608
syro 45 3608
cuba 47 3688
watts 48 3200
hobbit 49 3928
hobby 53 4240
rack-response 56 4136
rails-metal 60 5728
plezi 66 5040
hanami-router 68 4880
newark 72 5928
rackstep 81 4944
rack-app 83 7184
rambutan 83 5944
flame 125 8536
sinatra 191 12512
grape 272 20800
rails-api 385 28017
```
#### Hardware
These numbers were collected on:
- Ubuntu 16.10 64-bit (kernel: 4.8.0-56-generic)
- Dell XPS 13 (9343, QHD, Developer Edition)
- Intel® Core™ i7-5500U CPU @ 2.40GHz × 4
- 8GB RAM
- 256GB SSD
- ruby 2.4.1p111 (2017-03-22 revision 58053) [x86_64-linux]