Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/mrsimo/ruby-http-clients
Some benchmarking code for various ruby libraries
https://github.com/mrsimo/ruby-http-clients
Last synced: 12 days ago
JSON representation
Some benchmarking code for various ruby libraries
- Host: GitHub
- URL: https://github.com/mrsimo/ruby-http-clients
- Owner: mrsimo
- License: mit
- Created: 2016-09-11T20:01:13.000Z (about 8 years ago)
- Default Branch: master
- Last Pushed: 2018-06-05T11:18:42.000Z (over 6 years ago)
- Last Synced: 2024-08-01T19:45:36.020Z (3 months ago)
- Language: Ruby
- Size: 41 KB
- Stars: 15
- Watchers: 0
- Forks: 2
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE.txt
Awesome Lists containing this project
README
# Ruby HTTP Clients
This is my benchmark of ruby http client libraries. There are many like it, but this one is mine.
I started this project as way for me to easily test different setups and different ways of using
the various ruby http clients.
To run it just clone this repository and run `bundle install` on it. You can then call
`bin/benchmark` against an arbitrary URL. Run `bin/benchmark --help` for the different options.
Don't take these numbers as an official statement on how fast each client is. Each application is
different and your needs too. Keep reading this README for some more rambles.
## Contributing
I'd be very happy to include more clients here, or fix any issues in my implementations.
## bin/benchmark
```
$ bin/benchmark --help
Usage: bin/benchmark [options] URL
-n, --number N Run N requests
-p, --persistent Try to use a persistent connection if supported by the client
-c, --concurrent Try to fire requests in parallel
--client CLIENT Run just one client
```
* `-n, --number N`: Specify how many requests to run in total for each client.
```
$ bin/benchmark -n100 https://localhost:3000/delay/50
x==================x=============x=============x=============x
| 100 requests against https://localhost:3000/delay/50 |
x==================x=============x=============x=============x
| | Average | Total | |
x==================x=============x=============x=============x
| net/http | 76.70ms | 7670.39ms | All OK |
| http.rb | 77.44ms | 7743.94ms | All OK |
| Excon | 80.13ms | 8012.53ms | All OK |
| Typhoeus | 80.86ms | 8086.44ms | All OK |
| Patron | 80.91ms | 8091.24ms | All OK |
| Curb | 81.08ms | 8107.74ms | All OK |
| Faraday+net/http | 85.88ms | 8587.74ms | All OK |
| REST Client | 87.21ms | 8721.41ms | All OK |
x==================x=============x=============x=============x
```
* `-p, --persistent`: Try to setup a persistent connection instead of individual requests.
```
$ bin/benchmark -n100 -p https://localhost:3000/delay/50
x====================x====================x====================x====================x
| 100 requests with persistent connection against https://localhost:3000/delay/50 |
x====================x====================x====================x====================x
| | Average | Total | |
x====================x====================x====================x====================x
| Curb | 54.72ms | 5472.21ms | All OK |
| Typhoeus | 54.89ms | 5488.55ms | All OK |
| Patron | 54.98ms | 5497.94ms | All OK |
| net/http | 55.02ms | 5501.73ms | All OK |
| Excon | 55.21ms | 5520.60ms | All OK |
| http.rb | 55.55ms | 5555.46ms | All OK |
| Faraday+net/http | 65.38ms | 6538.30ms | All OK |
x====================x====================x====================x====================x
```
* `-c, --concurrent`: Try to run requests in a concurrent way. With Typhoeus, for example, it will run with a maximum concurrency of 5.
```
$ bin/benchmark -n100 -c https://localhost:3000/delay/50
x================x================x================x================x
| 100 requests concurrently against https://localhost:3000/delay/50 |
x================x================x================x================x
| | Average | Total | |
x================x================x================x================x
| Typhoeus | 13.34ms | 1333.77ms | All OK |
| Curb | 24.37ms | 2437.18ms | All OK |
x================x================x================x================x
```
## bin/server-*
You can easily boot a rails application to respond to these requests by running `bin/server-http` or `bin/server-https`. They'll
be available under `localhost:3000` using Puma. For https, the certificate is self-signed.
By default, this application does nothing, but you can pass a delay and it will sleep for the
specified number of milliseconds. Call `/delay/50` to have the request sleep for 50 milliseconds.
## Commentary
Each application is different. If you're doing one-off requests every now and then, these
performance metrics might not help you a lot. You're probably good enough using net/http or any
gem that wraps around it. Faraday is a very nice way to do that, but from what I've seen here,
you pay a small penalty. If the request is going to take 150ms, then 10 more ms on top won't make
much difference, so even that might be OK.
If you have to do many small requests, all to the same host, you should probably look into a
library that supports persistent connections. This would happen, for instance, if you're in a
service-oriented architecture, and each request to your service requires you to do one or more
requests to other services. This is even worse if that request has to go through https–a
request that the server might be able to put together in 5 or 10ms, might end up 50 to 60ms
slower just because of TLS negotiation. If you have a persistent connection you can avoid most
of that.
And of course, concurrent requests are very important if you have to make multiple requests
at the same time. You can do N requests taking the time of the slowest one.