https://github.com/pilotpirxie/sqlite-experiments
Just bunch of benchmarking and experiments over sqlite3
https://github.com/pilotpirxie/sqlite-experiments
Last synced: 7 months ago
JSON representation
Just bunch of benchmarking and experiments over sqlite3
- Host: GitHub
- URL: https://github.com/pilotpirxie/sqlite-experiments
- Owner: pilotpirxie
- License: mit
- Created: 2023-09-21T18:06:02.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2023-09-29T20:40:28.000Z (about 2 years ago)
- Last Synced: 2025-01-12T08:22:06.395Z (9 months ago)
- Language: JavaScript
- Homepage:
- Size: 91.8 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# sqlite-experiments
Just bunch of experiments with SQLite3 using ``better-sqlite3`` and ``fastify``. Tested with both ``node`` (after ``tsc`` transpilation) and ``ts-node``.
# Using node
## Read performance (node)
Run using:
```shell
wrk -t10 -c400 -d10s http://localhost:3000/users
```
### Memory without WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 46.92ms 3.79ms 148.77ms 93.30%
Req/Sec 848.81 63.82 0.96k 88.90%
84608 requests in 10.03s, 707.32MB read
Socket errors: connect 0, read 711, write 0, timeout 0
Requests/sec: 8436.86
Transfer/sec: 70.53MB
```
### Memory with WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 46.29ms 4.06ms 136.68ms 92.80%
Req/Sec 0.86k 69.54 1.01k 86.30%
85958 requests in 10.02s, 718.60MB read
Socket errors: connect 0, read 628, write 0, timeout 0
Requests/sec: 8574.66
Transfer/sec: 71.68MB
```
### Disk without WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 45.55ms 3.65ms 152.20ms 93.17%
Req/Sec 0.87k 63.68 0.99k 86.10%
87167 requests in 10.03s, 728.71MB read
Socket errors: connect 0, read 569, write 0, timeout 0
Requests/sec: 8692.60
Transfer/sec: 72.67MB
```
### Disk with WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 44.29ms 3.88ms 119.59ms 92.95%
Req/Sec 0.90k 67.05 0.98k 88.50%
89658 requests in 10.03s, 749.53MB read
Socket errors: connect 0, read 886, write 0, timeout 0
Requests/sec: 8943.42
Transfer/sec: 74.77MB
```
## Write performance (node)
Run using:
```shell
wrk -t10 -c400 -d10s -s ./post.lua http://localhost:3000/users
```
### Memory without WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 12.52ms 2.03ms 44.80ms 83.41%
Req/Sec 3.19k 322.06 3.60k 91.70%
317686 requests in 10.01s, 68.06MB read
Socket errors: connect 0, read 726, write 0, timeout 0
Requests/sec: 31721.49
Transfer/sec: 6.80MB
```
### Memory with WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 12.44ms 1.93ms 47.34ms 84.48%
Req/Sec 3.21k 306.96 3.60k 92.70%
319804 requests in 10.01s, 68.52MB read
Socket errors: connect 0, read 463, write 0, timeout 0
Requests/sec: 31935.43
Transfer/sec: 6.84MB
```
### Disk without WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 99.69ms 10.39ms 212.21ms 95.22%
Req/Sec 398.25 27.51 505.00 84.50%
39729 requests in 10.03s, 8.48MB read
Socket errors: connect 0, read 698, write 0, timeout 0
Requests/sec: 3959.62
Transfer/sec: 865.09KB
```
### Disk with WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 17.23ms 2.01ms 55.81ms 86.41%
Req/Sec 2.32k 213.84 2.52k 94.90%
230538 requests in 10.02s, 49.36MB read
Socket errors: connect 0, read 475, write 0, timeout 0
Requests/sec: 23017.65
Transfer/sec: 4.93MB
```
# Using ts-node
## Read performance (ts-node)
Run using:
```shell
wrk -t10 -c400 -d10s http://localhost:3000/users
```
### Memory without WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 52.49ms 5.89ms 163.62ms 94.17%
Req/Sec 759.29 70.34 810.00 92.70%
75705 requests in 10.03s, 632.89MB read
Socket errors: connect 0, read 638, write 0, timeout 0
Requests/sec: 7547.44
Transfer/sec: 63.10MB
```
### Memory with WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 53.00ms 5.58ms 147.54ms 94.72%
Req/Sec 751.81 65.02 808.00 93.30%
74940 requests in 10.03s, 626.49MB read
Socket errors: connect 0, read 684, write 0, timeout 0
Requests/sec: 7471.59
Transfer/sec: 62.46MB
```
### Disk without WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 55.10ms 6.63ms 149.18ms 95.27%
Req/Sec 721.84 71.27 808.00 90.00%
71970 requests in 10.03s, 601.66MB read
Socket errors: connect 0, read 485, write 0, timeout 0
Requests/sec: 7172.80
Transfer/sec: 59.96MB
```
### Disk with WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 52.06ms 5.16ms 131.28ms 95.02%
Req/Sec 763.68 57.11 818.00 91.80%
76125 requests in 10.03s, 636.40MB read
Socket errors: connect 0, read 816, write 0, timeout 0
Requests/sec: 7590.37
Transfer/sec: 63.45MB
```
## Write performance (ts-node)
Run using:
```shell
wrk -t10 -c400 -d10s -s ./post.lua http://localhost:3000/users
```
### Memory without WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 13.07ms 2.07ms 36.47ms 83.48%
Req/Sec 3.06k 310.09 3.37k 93.00%
304216 requests in 10.01s, 65.17MB read
Socket errors: connect 0, read 601, write 0, timeout 0
Requests/sec: 30379.90
Transfer/sec: 6.51MB
```
### Memory with WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 13.07ms 2.08ms 38.39ms 84.39%
Req/Sec 3.06k 302.34 3.40k 94.00%
304290 requests in 10.02s, 65.19MB read
Socket errors: connect 0, read 668, write 0, timeout 0
Requests/sec: 30380.83
Transfer/sec: 6.51MB
```
### Disk without WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 101.99ms 11.61ms 224.72ms 91.32%
Req/Sec 389.38 32.43 474.00 81.10%
38850 requests in 10.04s, 8.29MB read
Socket errors: connect 0, read 732, write 0, timeout 0
Requests/sec: 3871.27
Transfer/sec: 845.76KB
```
### Disk with WAL
```shell
Running 10s test @ http://localhost:3000/users
10 threads and 400 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 18.05ms 1.94ms 54.48ms 79.64%
Req/Sec 2.21k 175.19 2.40k 95.60%
220006 requests in 10.01s, 47.10MB read
Socket errors: connect 0, read 643, write 0, timeout 0
Requests/sec: 21969.39
Transfer/sec: 4.70MB
```