Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/myaaghubi/php-frameworks-bench
A library to make benchmarks from PHP frameworks.
https://github.com/myaaghubi/php-frameworks-bench
benchmark cakephp codeigniter fastroute fatfree fuelphp kumbiaphp laminas laravel leaf lumen performance php phroute pure-php siler silex slim symfony yii
Last synced: 25 days ago
JSON representation
A library to make benchmarks from PHP frameworks.
- Host: GitHub
- URL: https://github.com/myaaghubi/php-frameworks-bench
- Owner: myaaghubi
- License: gpl-2.0
- Created: 2021-10-16T14:28:47.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2024-03-23T09:50:09.000Z (8 months ago)
- Last Synced: 2024-10-10T21:41:24.491Z (25 days ago)
- Topics: benchmark, cakephp, codeigniter, fastroute, fatfree, fuelphp, kumbiaphp, laminas, laravel, leaf, lumen, performance, php, phroute, pure-php, siler, silex, slim, symfony, yii
- Language: PHP
- Homepage:
- Size: 4.81 MB
- Stars: 108
- Watchers: 11
- Forks: 4
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# PHP Frameworks Bench
[](https://github.com/myaaghubi/PHP-Frameworks-Bench/actions/workflows/test.yml)  
📊 This project attempts to measure the minimum overhead (minimum bootstrap cost) of PHP frameworks in the real world.
So I think the minimum should not include:
* cost of template engine
* cost of database manipulation
* cost of debugging information
Benchmarking on components like template engines or ORM/Database libraries is out of the scope of this project.
- [PHP Frameworks Bench](#php-frameworks-bench)
- [Benchmarks](#benchmarks)
- [Latest](#latest)
- [OPCache On/Off](#opcache-on)
- [How to Benchmark](#how-to-benchmark)
- [Docker](#docker)
- [Commands](#commands)
- [Benchmarking Policy](#benchmarking-policy)
- [Add Your Framework](#add-your-framework)
- [Donate](#-donate)
- [References](#references)
- [License](#license)
## Benchmarks
### Latest
#### Environment
For `PHP 8.2` check out [this link](https://github.com/myaaghubi/PHP-Frameworks-Bench/tree/v2.3.1).
* Ubuntu 22.04 LTS x86_64
* PHP 8.3.0
* OPCache Off
* Apache 2.4.52
* WRK 4.2.0 (5 min)
* CPU Core i7-3770K/4.4Ghz
* Memory 16G
#### Results (2023/12/1)
These are my benchmarks, not yours. **I encourage you to run on your -production equivalent- environments.**
|framework |requests per second (rps)|relative (rps)|peak memory|relative (mem)|
|-------------------|------------------------:|-------------:|----------:|-------------:|
|pure-php | 27,077.31| 321.6| 0.42| 1.0|
|kumbia-1.1 | 5,921.29| 70.3| 0.54| 1.3|
|fastroute-1.3 | 4,516.12| 53.6| 0.56| 1.3|
|phroute-2.2 | 4,198.83| 49.9| 0.58| 1.4|
|leaf-3.5 | 1,487.36| 17.7| 1.11| 2.6|
|fatfree-3.8 | 1,453.82| 17.3| 1.72| 4.1|
|slim-4.12 | 798.17| 9.5| 1.57| 3.7|
|ubiquity-2.4.x.dev | 705.12| 8.4| 1.64| 3.9|
|silex-2.3 | 543.66| 6.5| 2.20| 5.2|
|yii-2.0-basic | 503.76| 6.0| 2.56| 6.1|
|fuelphp-1.9 | 429.18| 5.1| 2.61| 6.2|
|lumen-10.0 | 325.27| 3.9| 3.61| 8.6|
|symfony-5.4 | 309.74| 3.7| 3.77| 9.0|
|codeigniter-4.4 | 302.21| 3.6| 3.62| 8.6|
|symfony-7.0 | 286.46| 3.4| 4.07| 9.7|
|symfony-6.4 | 280.83| 3.3| 4.11| 9.8|
|cakephp-4.5 | 246.72| 2.9| 4.63| 11.0|
|cakephp-5.0 | 243.96| 2.9| 4.74| 11.3|
|laravel-10.2 | 84.19| 1.0| 13.06| 31.0|
#### OPCache On
Check out the video for more information.
[](http://www.youtube.com/watch?v=Dk8YHQZ6jfY)
## How to Benchmark
If you want to have benchmarks on `PHP extension frameworks` like `Phalcon`, you need to install the extension first, based on its own documentation.
1- Download & Setup:
```bash
# make sure to put it in the root of your web path
$ git clone https://github.com/myaaghubi/PHP-Frameworks-Bench.git
$ cd PHP-Frameworks-Bench
# optional
$ nano config
# run the setup & follow the progress
$ yes | bash setup.sh
```
2- Make sure everything is ok:
```bash
$ bash check.sh
# bash check.sh -t pure-php
# ✔ pure-php
```
3- Run benchmarks:
```bash
# bash benchmark.sh --help
$ bash benchmark.sh
```
4- Check the results:
- web:
- terminal:
```bash
# bash results.sh --help
bash results.sh
```
## Docker
Results with docker may or may not be reliable but in a situation you can use it like:
1- Change the `base` in `config` on the right port(`8080` considered):
```ini
base="http://127.0.0.1:8080/PHP-Frameworks-Bench"
...
```
2- Run/download the docker:
```bash
$ bash docker-apache.sh
```
3- Run the benchmark:
```bash
# run it in another terminal
$ bash benchmark.sh
```
## Commands
```bash
# use bash benchmark.sh --help
$ bash benchmark.sh -f -rapache -t pure-php
# run composer update for frameworks
$ bash update.sh
# to clean them all
# trouble? run it then
# you can use `bash setup.sh` again
$ bash clean.sh
# clear the cache of frameworks
$ bash clear-cache.sh
# show the results table
$ bash results.sh
```
To specify frameworks, put them with `-t ...` after each command:
```bash
# supported for `setup.sh`, `benchmark.sh`, `update.sh`, `clean.sh`, and `clear-cache.sh`
# bash benchmarks.sh --help
$ bash benchmark.sh -t laravel-10.2/ slim-4.12/ ...
...
```
## Add Your Framework
Check out the [Benchmarking Policy](#benchmarking-policy), to get more information watch the video [OPCache On/Off](#opcache-on).
## Benchmarking Policy
* Use `composer` to install frameworks according to their official documentation.
* Use the default configuration.
* Minimum changes on frameworks to have benchmarks.
* Don't remove any components/configurations even if there is no use for them.
* Include a `controller` class to get the `Hello World!` for each, based on the default template of each framework for `controllers`.
* Turn off the `debug` mode and set the environment to `production` mode.
* General optimization for the production environment, like `--optimize-autoloader` for the `composer`.
Some frameworks are optimized more than others, so some developers may think using default configuration is not fair. The dept of optimizing a framework depends on the skills/experiences of the developer too, so it's the rabbit hole and nonsense for ranking. Please **note** optimizing for the `Hello World` is not acceptable! Building the fastest `Hello World` application is not the goal of this project. I think the default configuration of frameworks is a good starting point to have a ranking.
If you find something wrong in my code, feel free to send a `PR`.
## 🍔 Donate
Don't forget to donate if you find it useful ☕ 🍺 🍸 🍔
ETH: 0x0ADd51D6855d2DF11BB5F331A3fa345c67a863b2
## References
Note: This project is based on
[php-framework-benchmark](https://github.com/kenjis/php-framework-benchmark), thanks to [Kenjis](https://github.com/kenjis). It is very old and abandoned, so I decided to split it from the origin and change/update it separately.
🙏 Thanks to contributors:
- [Joan Miquel](https://github.com/joanhey)
- [Rostunov Sergey](https://github.com/stdex)
📄 For frameworks, I considered the official repos:
* [CakePHP](https://github.com/cakephp/cakephp)
* [CodeIgniter](https://github.com/codeigniter4/CodeIgniter4)
* [FastRoute](https://github.com/nikic/FastRoute)
* [FatFree](https://github.com/bcosca/fatfree)
* [FuelPHP](https://github.com/fuelphp/fuelphp)
* [KumbiaPHP](https://github.com/KumbiaPHP/KumbiaPHP)
* [Laminas](https://github.com/laminas)
* [Laravel](https://github.com/laravel/laravel)
* [Leaf](https://github.com/leafsphp/leaf)
* [Lumen](https://github.com/laravel/lumen)
* [PhRoute](https://github.com/mrjgreen/phroute)
* [Silex](https://github.com/silexphp/Silex)
* [Slim](https://github.com/slimphp/Slim)
* [Symfony](https://github.com/symfony/symfony)
* [Ubiquity](https://github.com/phpMv/ubiquity)
* [Yii](https://github.com/yiisoft/yii2)
## License
You are allowed to use this plugin/project under the terms of the GNU General Public License version 2.
Copyright (C) 2024 [Mohammad Yaaghubi](https://github.com/myaaghubi)