Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/appleboy/golang-graphql-benchmark

benchmark of golang GraphQL framework.
https://github.com/appleboy/golang-graphql-benchmark

benchmark golang graphql

Last synced: 3 days ago
JSON representation

benchmark of golang GraphQL framework.

Host: GitHub
URL: https://github.com/appleboy/golang-graphql-benchmark
Owner: appleboy
License: mit
Created: 2018-06-17T09:03:23.000Z (over 6 years ago)
Default Branch: master
Last Pushed: 2023-08-06T13:01:55.000Z (about 1 year ago)
Last Synced: 2024-05-21T07:34:59.823Z (6 months ago)
Topics: benchmark, golang, graphql
Language: Go
Homepage:
Size: 7.61 MB
Stars: 130
Watchers: 9
Forks: 12
Open Issues: 6
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

# golang-graphql-benchmark

[![Build Status](https://cloud.drone.io/api/badges/appleboy/golang-graphql-benchmark/status.svg)](https://cloud.drone.io/appleboy/golang-graphql-benchmark)

benchmark of graphql framework in [go1.15](https://golang.org/doc/go1.15) version.

* [graphql-go/graphql](https://github.com/graphql-go/graphql) version: v0.7.9
* [playlyfe/go-graphql](https://github.com/playlyfe/go-graphql) version: v0.0.0-20191219091308-23c3f22218ef
* [graph-gophers/graphql-go](https://github.com/graph-gophers/graphql-go) version: v0.0.0-20200622220639-c1d9693c95a6
* [samsarahq/thunder](https://github.com/samsarahq/thunder) version: v0.5.0
* [99designs/gqlgen](https://github.com/99designs/gqlgen) version: v0.13.0

## Benchmark Result (2020/09/26)

Please execute the following command.

```sh
git clone https://github.com/appleboy/golang-graphql-benchmark.git
cd golang-graphql-benchmark
go test -v -bench=Master -benchmem
```

Result:

```sh
goos: linux
goarch: amd64
pkg: github.com/appleboy/golang-graphql-benchmark
BenchmarkGoGraphQLMaster-48 12556 95348 ns/op 27433 B/op 444 allocs/op
BenchmarkPlaylyfeGraphQLMaster-48 123614 10340 ns/op 2857 B/op 56 allocs/op
BenchmarkGophersGraphQLMaster-48 165276 7354 ns/op 3683 B/op 38 allocs/op
BenchmarkThunderGraphQLMaster-48 324900 3755 ns/op 1336 B/op 30 allocs/op
```

Testing with http framwork using [Gin](https://github.com/gin-gonic/gin)

```sh
go test -v -bench=Route -benchmem
```

Result:

```sh
goos: linux
goarch: amd64
pkg: github.com/appleboy/golang-graphql-benchmark
BenchmarkGinHttpRoute-48 397496 2790 ns/op 1262 B/op 18 allocs/op
BenchmarkGinGQLGenRoute-48 383760 3034 ns/op 986 B/op 13 allocs/op
BenchmarkGinGoGraphQLRoute-48 29984 38296 ns/op 17489 B/op 226 allocs/op
BenchmarkGinGopherGraphQLRoute-48 952279 1189 ns/op 972 B/op 6 allocs/op
BenchmarkGinThunderGraphQLRoute-48 571414 1840 ns/op 1193 B/op 11 allocs/op
```

## Benchmark from wrk benchmarking tool

[wrk](https://github.com/wg/wrk) - a HTTP benchmarking tool

### [gin + graphql-go](golang/graphql-go)

```sh
$ wrk -t12 -c400 -d30s --timeout 10s --script=golang/post.lua --latency http://localhost:8080/graphql
Running 30s test @ http://localhost:8080/graphql
12 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 78.26ms 114.59ms 1.31s 86.37%
Req/Sec 1.59k 537.11 4.15k 68.81%
Latency Distribution
50% 7.68ms
75% 128.89ms
90% 221.97ms
99% 499.33ms
571048 requests in 30.05s, 81.14MB read
Socket errors: connect 0, read 233, write 0, timeout 0
Requests/sec: 19004.92
Transfer/sec: 2.70MB
```

### [gin + graph-gophers](golang/graph-gophers)

```sh
$ wrk -t12 -c400 -d30s --timeout 10s --script=golang/post.lua --latency http://localhost:8080/graphql
Running 30s test @ http://localhost:8080/graphql
12 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 10.75ms 10.75ms 214.71ms 88.06%
Req/Sec 3.71k 583.50 6.30k 72.11%
Latency Distribution
50% 7.21ms
75% 12.15ms
90% 23.80ms
99% 53.21ms
1331529 requests in 30.05s, 170.16MB read
Socket errors: connect 0, read 236, write 0, timeout 0
Requests/sec: 44308.44
Transfer/sec: 5.66MB
```

### [gin + thunder](golang/thunder)

```sh
$ wrk -t12 -c400 -d30s --timeout 10s --script=golang/post.lua --latency http://localhost:8080/graphql
Running 30s test @ http://localhost:8080/graphql
12 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 12.34ms 13.20ms 181.22ms 85.99%
Req/Sec 3.43k 540.37 5.90k 72.64%
Latency Distribution
50% 8.09ms
75% 17.52ms
90% 30.13ms
99% 58.72ms
1232462 requests in 30.06s, 224.50MB read
Socket errors: connect 0, read 232, write 0, timeout 0
Requests/sec: 40994.33
Transfer/sec: 7.47MB
```

### [gin + gqlgen](golang/gqlgen/gin-server)

```sh
$ wrk -t12 -c400 -d30s --timeout 10s --script=golang/post.lua --latency http://localhost:8080/graphql
Running 30s test @ http://localhost:8080/graphql
12 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 7.77ms 2.61ms 66.76ms 82.63%
Req/Sec 4.18k 474.51 9.97k 83.78%
Latency Distribution
50% 7.48ms
75% 8.47ms
90% 9.99ms
99% 18.09ms
1501098 requests in 30.07s, 191.83MB read
Socket errors: connect 0, read 239, write 0, timeout 0
Requests/sec: 49925.73
Transfer/sec: 6.38MB
```

### [net/http + gqlgen](golang/gqlgen/httpd-server)

```sh
$ wrk -t12 -c400 -d30s --timeout 10s --latency http://localhost:8080/graphql?query={hello}
Running 30s test @ http://localhost:8080/graphql?query={hello}
12 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 7.61ms 4.44ms 143.61ms 97.03%
Req/Sec 4.43k 491.36 6.86k 80.94%
Latency Distribution
50% 7.24ms
75% 8.04ms
90% 8.99ms
99% 18.35ms
1588061 requests in 30.05s, 216.57MB read
Socket errors: connect 0, read 255, write 0, timeout 0
Requests/sec: 52854.88
Transfer/sec: 7.21MB
```

### [gin + josn](golang/gin-json)

```sh
$ wrk -t12 -c400 -d30s --timeout 10s --script=golang/json.lua --latency http://localhost:8080/graphql
Running 30s test @ http://localhost:8080/graphql
12 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 7.05ms 1.94ms 40.57ms 81.71%
Req/Sec 4.64k 415.61 7.95k 85.89%
Latency Distribution
50% 6.89ms
75% 7.66ms
90% 8.79ms
99% 14.50ms
1663093 requests in 30.06s, 356.86MB read
Socket errors: connect 0, read 236, write 0, timeout 0
Non-2xx or 3xx responses: 1663093
Requests/sec: 55334.07
Transfer/sec: 11.87MB
```

## Summary

| | Requests/sec |
| ----------------- | ------------ |
| graphql-go | 19004.92 |
| graph-gophers | 44308.44 |
| thunder | 40994.33 |
| gqlgen + gin | 49925.73 |
| gqlgen + net/http | **52854.88** |

Without graphql (only gin render json output)

| | Requests/sec |
| -------------------- | ------------- |
| json without graphql | **55334.07** |