https://github.com/static-web-server/benchmarks
A benchmark suite which measures the requests per second and latency on average for several web servers.
https://github.com/static-web-server/benchmarks
Last synced: 3 months ago
JSON representation
A benchmark suite which measures the requests per second and latency on average for several web servers.
- Host: GitHub
- URL: https://github.com/static-web-server/benchmarks
- Owner: static-web-server
- Created: 2023-04-15T22:48:53.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2023-04-29T13:30:07.000Z (over 2 years ago)
- Last Synced: 2025-04-06T12:39:53.914Z (9 months ago)
- Language: Lua
- Homepage:
- Size: 47.9 KB
- Stars: 4
- Watchers: 1
- Forks: 0
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Static Web Servers Benchmarks
> A benchmark suite which measures the requests per second and latency on average for several web servers.
## Motivation and context
We wanted to prepare some benchmarks to have a general idea about the SWS performance path over time as well as an excuse to improve/optimize SWS in that regard.
## Important Remarks
- Note that this is a rough reference about some particular performance aspects (requests per second and latency on average) so take it *at your own risk*.
- Be also aware that **_this benchmark disables in-memory cache_** for some servers intentionally since SWS doesn't provide such a feature yet.
In the case of some web servers providing that by default then it gets disabled explicitly. See for example [*binserve's author comment*](https://github.com/static-web-server/static-web-server/issues/156#issuecomment-1293941692) in this context.
- Have also in mind that some web servers follow approaches like [Nignx's hybrid disk‑and‑memory cache strategy](https://www.nginx.com/blog/cache-placement-strategies-nginx-plus#Where-is-Cached-Data-Stored) which could work in its favor.
## Benchmarks history
- [2023-04](./data/2023-04)
- [2022-10](./data/2022-10)
## Perform the benchmarks
Change `URL` env with the corresponding server URL to load test and generate the [wrk](https://github.com/wg/wrk) metrics.
```sh
# NOTE: the load test is per server
SERVER="sws" URL="http://localhost" make wrk
# wrk -c 500 -t 12 -d 10s --latency http://localhost
```
After that, `wrk` will save two files (JSON/CSV) on disk with the resulting metrics.
For more details about settings see [Makefile](./Makefile)
## System used
- **OS:** Arch Linux
- **Kernel:** 6.1.11-arch1-1 (64 bits)
- **Processor:** 4 × Intel® Core™ i7-6500U
- **RAM:** 8 GiB
## Contributions
Of course, if you find any issue or remark/improvement to do please don't hesitate to file an [issue](https://github.com/static-web-server/static-web-server/issues) or send a [Pull request](https://github.com/static-web-server/static-web-server/pulls).