https://github.com/tarantool-php/benchmarks

Benchmarks for Tarantool PHP connectors.
https://github.com/tarantool-php/benchmarks

benchmarking ext-async ext-parallel ext-swoole performance tarantool tarantool-connector

Last synced: 10 months ago
JSON representation

Benchmarks for Tarantool PHP connectors.

• Host: GitHub
• URL: https://github.com/tarantool-php/benchmarks
• Owner: tarantool-php
• License: mit
• Created: 2019-07-15T20:46:09.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2020-05-02T23:22:55.000Z (almost 6 years ago)
• Last Synced: 2025-04-12T19:09:09.775Z (10 months ago)
• Topics: benchmarking, ext-async, ext-parallel, ext-swoole, performance, tarantool, tarantool-connector
• Language: PHP
• Homepage:
• Size: 247 KB
• Stars: 6
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE

Awesome Lists containing this project

README

          
# Benchmarks for Tarantool PHP connectors

[![Telegram](https://img.shields.io/badge/Telegram-join%20chat-blue.svg)](https://t.me/tarantool_php)

This repository contains code to benchmark PHP connectors for [Tarantool](https://www.tarantool.io/en/developers/).

Currently, there are two connectors available:

 * [tarantool/client](https://github.com/tarantool-php/client) written in pure PHP 

 * The official [PECL](https://github.com/tarantool/tarantool-php) extension

 

*A more detailed explanation of the benchmarks represented in this repository can be found in [this article](https://habr.com/en/company/mailru/blog/480032/).*

## Requirements

 * PHP 7.1+ (NTS and ZTS)

 * [Composer](https://getcomposer.org/)

 * [Tarantool](https://www.tarantool.io/) 1.7.1+

 * [ext-msgpack](https://github.com/msgpack/msgpack-php) to benchmark `Tarantool\Client\Packer\PeclPacker`

 * ext-async ([fork](https://github.com/dreamsxin/ext-async)) to benchmark connectors in async mode

 * [ext-parallel](https://github.com/krakjoe/parallel) to benchmark connectors in parallel mode

 * [ext-swoole](https://github.com/swoole/swoole-src) to benchmark connectors in async mode

 * [ext-tarantool](https://github.com/tarantool/tarantool-php) to benchmark the official PHP connector

## Usage

First, make sure you have the [bench.lua](bench.lua) instance running.

> If you want to run it on Docker, execute:

>

> ```bash

> docker run -d --network host --name=tarantool-bench \

>    -v $PWD/bench.lua:/bench.lua tarantool/tarantool:2 tarantool /bench.lua

> ```

Then run

```bash

make

```

to see the usage text and a list of all available benchmarks. For example, to (re)run all benchmarks, execute

```bash

make clean bench-all

```

> Alternatively, you may run benchmarks on Docker using Docker Compose: 

>

> ```bash

> docker-compose run --rm benchmarks make clean bench-all

> ```

You may change default benchmark settings by defining the following environment variables

(in parentheses are the default values):

 * `TNT_BENCH_TARANTOOL_URI` *(`tcp://localhost:3301`)*

 * `TNT_BENCH_TEMPLATE` *(`default.php.tpl`)*

 * `TNT_BENCH_ITERATIONS` *(`5`)*

 * `TNT_BENCH_REVOLUTIONS` *(`10000`)*

 * `TNT_BENCH_RETRY_THRESHOLD` *(`3`)*

For example:

```bash

make clean bench-all TNT_BENCH_REVOLUTIONS=20000 TNT_BENCH_RETRY_THRESHOLD=5 

```

## Results

The below results were made by running benchmarks on Apple MacBook Pro (2015) on the following environment: 

 * Linux Fedora 30, kernel 5.3.8-200.fc30.x86_64 

 * Tarantool 2.3.0-115-g5ba5ed37e running on Docker

 * Docker 19.03.3, build a872fc2f86

 * PHP 7.3.11 (cli) (built: Oct 22 2019 08:11:04) ( NTS )

 * PHP 7.3.11 (cli) (built: Oct 22 2019 08:11:04) ( ZTS )

 * tarantool/client 0.6.0

 * rybakit/msgpack 0.6.1

 * ext-tarantool 0.3.2 with the [patch](https://github.com/tarantool/tarantool-php/pull/148/files)

 * ext-msgpack 2.0.3

 * ext-async 0.3.0-8c1da46

 * ext-swoole 4.4.12

 * ext-parallel 1.1.3

#### Sync connectors

![chart](reports/charts/_sync_connectors.png)

#### Sync client packers

![chart](reports/charts/_sync_client_packers.png)

#### Sync client protocols

![chart](reports/charts/_sync_client_protocols.png)

#### Async coroutines

![chart](reports/charts/_async_coroutines.png)

#### Async connectors

![chart](reports/charts/_async_connectors.png)

#### Async client protocols

![chart](reports/charts/_async_client_protocols.png)

#### Swoole coroutines

![chart](reports/charts/_swoole_coroutines.png)

#### Swoole connectors

![chart](reports/charts/_swoole_connectors.png)

#### Swoole client protocols

![chart](reports/charts/_swoole_client_protocols.png)

#### Parallel threads

![chart](reports/charts/_parallel_threads.png)

#### Parallel connectors

![chart](reports/charts/_parallel_connectors.png)

#### Parallel client protocols

![chart](reports/charts/_parallel_client_protocols.png)

#### All extensions

![chart](reports/charts/_extensions.png)

## License

The library is released under the MIT License. See the bundled [LICENSE](LICENSE) file for details.