https://github.com/binakot/abstract-rest-service-benchmark
A set of template services in different languages and frameworks. An abstract performance comparison based on the endpoint throughput. There are no objective benefits, just an elementary comparison of primitive RESTful API services. :shipit:
https://github.com/binakot/abstract-rest-service-benchmark
benchmark hacktoberfest hacktoberfest-accepted performance rest-api service template test throughput
Last synced: 8 months ago
JSON representation
A set of template services in different languages and frameworks. An abstract performance comparison based on the endpoint throughput. There are no objective benefits, just an elementary comparison of primitive RESTful API services. :shipit:
- Host: GitHub
- URL: https://github.com/binakot/abstract-rest-service-benchmark
- Owner: binakot
- License: mit
- Created: 2017-11-11T18:53:22.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2020-10-23T06:05:14.000Z (over 5 years ago)
- Last Synced: 2025-04-14T06:31:28.679Z (about 1 year ago)
- Topics: benchmark, hacktoberfest, hacktoberfest-accepted, performance, rest-api, service, template, test, throughput
- Language: C#
- Homepage:
- Size: 329 KB
- Stars: 16
- Watchers: 2
- Forks: 14
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Abstract Rest Service Benchmark
[](https://sourcerer.io/fame/binakot/binakot/Abstract-Rest-Service-Benchmark/links/0)[](https://sourcerer.io/fame/binakot/binakot/Abstract-Rest-Service-Benchmark/links/1)[](https://sourcerer.io/fame/binakot/binakot/Abstract-Rest-Service-Benchmark/links/2)[](https://sourcerer.io/fame/binakot/binakot/Abstract-Rest-Service-Benchmark/links/3)[](https://sourcerer.io/fame/binakot/binakot/Abstract-Rest-Service-Benchmark/links/4)[](https://sourcerer.io/fame/binakot/binakot/Abstract-Rest-Service-Benchmark/links/5)[](https://sourcerer.io/fame/binakot/binakot/Abstract-Rest-Service-Benchmark/links/6)[](https://sourcerer.io/fame/binakot/binakot/Abstract-Rest-Service-Benchmark/links/7)
## Requirements
* PORT: `8080`
* API request: `/api/test`
* API response: `Hello, World!` *(text/plain, UTF-8, 13 bytes)*
## Benchmark
Command for [WRK](https://github.com/wg/wrk):
```bash
$ wrk -t8 -c512 -d2m --timeout 10s --latency http://localhost:8080/api/test
```
---
## Results
| # | Service | Language | Framework | RPS |
| - | ------- | -------- | --------- | --- |
| | [Java Light 4J](/java-light-4j/) | Java | oracle jdk 9.0.4 + ligth4j | 401511.94 |
| | [.Net Core](/dot-net-core/) | C# | dotnet 2.1.4 | 249758.46 |
| | [Haskell Warp](/haskell-warp/) | Haskell | ghc 7.10.3 + warp | 191020.62 |
| | [Rust Iron](/rust-iron/) | Rust | rust 1.24.1 + iron | 186726.17 |
| | [Go Gorilla/Mux](/go-gorilla-mux/) | Golang | go sdk 1.9.4 + gorilla/mux | 131499.79 |
| | [.Net Core ASP.NET MVC](/dot-net-core-asp-net/) | C# | dotnet 2.1.4 | 99091.85 |
| | [NodeJS](/nodejs/) | JavaScript | nodejs 8.9.4 | 94132.92 |
| | [Python Sanic](/python-sanic/) | Python | python 3.5.2 + sanic| 74854.41 |
| | [NodeJS Express](/nodejs-express/) | JavaScript | nodejs 8.9.4 + express | 58769.29 |
| | [Java Spring Boot](/java-spring-boot/) | Java | oracle jdk 9.0.4 + spring boot | 56253.12 |
| | [.Net Core Freya](/dot-net-core-freya/) | F# | dotnet 2.1.4 + freya-hopac | 49736.08 |
| | [Python Aiohttp](/python-aiohttp/) | Python | python 3.5.2 + aiohttp | 4603.01 |
| | [Python Flask](/python-flask/) | Python | python 3.5.2 + flask | 200.44 |
| | [.Net Core Websocket](/dot-net-core-websocket/) | C# | dotnet 2.1.4 + websocket | TBD |
| | [.Net Core Giraffe](/dot-net-core-giraffe/) | F# | dotnet 2.1.4 + giraffe | TBD |
| | [Python API Star](/python-apistar/) | Python | python 3.5.2 + apistar | TBD |
| | [Rust Rocket](/rust-rocket/) | Rust | rust 1.24.1 + rocket | TBD |
---
## Services
### .Net Core by [@vanbukin](https://github.com/vanbukin)
Language: C#
Framework: .Net Core 2
Run:
```bash
$ dotnet restore
$ dotnet publish -c Release
$ export ASPNETCORE_ENVIRONMENT=Production
$ export ASPNETCORE_URLS=http://0.0.0.0:8080
$ cd ./dotNetCoreRestService/bin/Release/netcoreapp2.1/publish
$ dotnet dotNetCoreRestService.dll
```
Result:
```text
TBD
```
---
### .Net Core ASP.NET MVC by [@binakot](https://github.com/binakot)
Language: C#
Framework: .Net Core 2, ASP.NET MVC
Main tutorial: https://docs.microsoft.com/en-us/aspnet/core/tutorials/first-web-api
Run:
```bash
$ dotnet restore
$ dotnet publish -c Release
$ export ASPNETCORE_ENVIRONMENT=Production
$ export ASPNETCORE_URLS=http://0.0.0.0:8080
$ cd ./dotNetCoreRestService/bin/Release/netcoreapp2.0/publish
$ dotnet dotNetCoreRestService.dll
```
Result:
```text
TBD
```
---
### .Net Core Websocket by [@petriashev](https://github.com/petriashev)
Language: C#
Framework: .Net Core 2, Websocket
Run:
```bash
$ dotnet restore
$ dotnet publish -c Release
$ export ASPNETCORE_ENVIRONMENT=Production
$ export ASPNETCORE_URLS=http://0.0.0.0:8080
$ cd ./bin/Release/netcoreapp2.0/publish
$ dotnet dot-net-core-websocket.dll
```
Result:
```text
TBD
```
---
### .Net Core Freya by [@Szer](https://github.com/Szer)
Language: F#
Framework: .Net Core 2, Freya
Run:
```bash
$ dotnet restore
$ dotnet publish -c Release
$ export ASPNETCORE_ENVIRONMENT=Production
$ export ASPNETCORE_URLS=http://0.0.0.0:8080
$ cd ./bin/Release/netcoreapp2.0/publish
$ dotnet dot-net-core-hopac-freya.dll
```
Result:
```text
TBD
```
---
### .Net Core Giraffe by [@Szer](https://github.com/Szer)
Language: F#
Framework: .Net Core 2, Giraffe
Run:
```bash
$ dotnet restore
$ dotnet publish -c Release
$ export ASPNETCORE_ENVIRONMENT=Production
$ export ASPNETCORE_URLS=http://0.0.0.0:8080
$ cd ./bin/Release/netcoreapp2.0/publish
$ dotnet dot-net-core-giraffe.dll
```
Result:
```text
TBD
```
---
### Go Gorilla/Mux by [@binakot](https://github.com/binakot)
Language: Go
Framework: Go SDK, Gorilla/Mux
Main tutorial: https://www.codementor.io/codehakase/building-a-restful-api-with-golang-a6yivzqdo
Run:
```bash
$ go build
$ ./go
```
Result:
```text
TBD
```
---
### Haskell Warp by [@kchugalinskiy](https://github.com/kchugalinskiy)
Language: Haskell
Framework: GHC, Warp
Main tutorial: http://taylor.fausak.me/2014/10/21/building-a-json-rest-api-in-haskell
Requirements:
* Install Haskell stack: https://docs.haskellstack.org/en/stable/README
* Install Cabal package: `cabal install Cabal-2.0.1.1`
Run:
```bash
$ stack setup
$ stack build
$ stack exec .stack-work/dist/**/build/test-exe/test-exe
```
Result:
```text
TBD
```
---
### Java
Language: Java
Framework: Oracle JDK 8 or above
Run:
```bash
$ gradle clean run
```
Result:
```text
TBD
```
---
### Java Light 4J by [@0ffer](https://github.com/0ffer)
Language: Java
Framework: Oracle JDK 9, Light4J
Main tutorial: https://github.com/networknt/light-example-4j/tree/master/demo
Run:
```bash
$ mvn clean install
$ java -jar target/service-example-0.1.0.jar
```
Result:
```text
TBD
```
---
### Java Spring Boot by [@binakot](https://github.com/binakot)
Language: Java
Framework: Oracle JDK 9, Spring Boot
Main tutorial: http://spring.io/guides/gs/rest-service
Run:
```bash
$ gradle clean build
$ java -jar build/libs/java-spring-boot-rest-service-1.0-SNAPSHOT.jar
```
Result:
```text
TBD
```
---
### NodeJS by [@WilixLead](https://github.com/WilixLead)
Language: JavaScript
Framework: Node.js
Main tutorial: https://nodejs.org/api/http.html#http_class_http_server
Run:
```bash
$ node ./index.js
```
Result:
```text
TBD
```
---
### NodeJS Express by [@WilixLead](https://github.com/WilixLead)
Language: JavaScript
Framework: Node.js, Express
Main tutorial: http://expressjs.com/en/starter/hello-world.html
Run:
```bash
$ npm i
$ node ./index.js
```
Result:
```text
TBD
```
---
### Python Aiohttp by [@TyVik](https://github.com/TyVik)
Language: Python
Framework: Python 3, Aiohttp
Main tutorial: https://aiohttp.readthedocs.io/en/stable/
Run:
```bash
$ pip install -r requirements.txt
$ python app.py
```
Result:
```text
TBD
```
---
### Python API Star by [@sergeibershadsky](https://github.com/sergeibershadsky)
Language: Python
Framework: Python 3, API Star
Main tutorial: https://github.com/encode/apistar
Run:
```bash
pip install -r requirements.txt
uvicorn app:app --workers=8 --bind=0.0.0.0:8080 --pid=pid
```
Results:
```text
TBD
```
---
### Python Flask by [@TyVik](https://github.com/TyVik)
Language: Python
Framework: Python 3, Flask
Main tutorial: http://flask.pocoo.org/
Run:
```bash
$ pip install -r requirements.txt
$ python app.py
```
Result:
```text
TBD
```
---
### Python Sanic by [@TyVik](https://github.com/TyVik)
Language: Python
Framework: Python 3, Sanic
Main tutorial: http://sanic.readthedocs.io/en/latest/
Run:
```bash
$ pip install -r requirements.txt
$ python app.py
```
Results:
```text
TBD
```
---
### Rust Iron by [@kchugalinskiy](https://github.com/kchugalinskiy)
Language: Rust
Framework: Rust SDK, Iron
Main tutorial: https://github.com/iron/router/blob/master/examples/simple.rs
Run:
```bash
$ cargo run --release
```
Result:
```text
TBD
```
---
### Rust Rocket by [@qezz](https://github.com/qezz)
Language: Rust
Framework: Rust SDK, Rocket
Main tutorial: https://rocket.rs/guide/getting-started/#hello-world
Run:
```bash
$ ROCKET_ENV=prod cargo run --release
```
Result:
```text
TBD
```
---
## Hardware
* Server (rest-service) host:
```text
TBD
```
* Client (wrk) host:
```text
TBD
```