https://github.com/antvirf/aws-aurora-vs-rds-performance-benchmark
Terraform code to bring up test instances of RDS PostgreSQL and Aurora PostgreSQL for performance becnhmarking.
https://github.com/antvirf/aws-aurora-vs-rds-performance-benchmark
Last synced: 3 months ago
JSON representation
Terraform code to bring up test instances of RDS PostgreSQL and Aurora PostgreSQL for performance becnhmarking.
- Host: GitHub
- URL: https://github.com/antvirf/aws-aurora-vs-rds-performance-benchmark
- Owner: Antvirf
- Created: 2023-06-17T01:26:32.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2023-06-17T03:27:55.000Z (almost 2 years ago)
- Last Synced: 2025-01-23T13:13:40.618Z (5 months ago)
- Language: HCL
- Size: 262 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# AWS PostgreSQL 15.2: RDS vs. RDS Performance and cost comparison
For full writeup please refer to the article [here](https://aviitala.com/posts/aws-rds-vs-aurora-postgresql-performance-comparison/).
## Bring up infrastructure
You will need to configure certain sensitive parts of the infrastructure - see the [hidden.tfexample](./hidden.tfexample) file. Update as needed and rename to `hidden.tf` before running the below commands.
```bash
make init # initialize terraform
make apply # create infrastructure
```## Raw results
## Aurora
### Iteration 1: 4 jobs, 4 clients
scaling factor: 5000
query mode: simple
number of clients: 4
number of threads: 4
duration: 600 s
number of transactions actually processed: 274822
latency average = 8.733 ms
initial connection time = 21.170 ms
tps = 458.047171 (without initial connection time)### Iteration 1: 8 jobs, 8 clients
query mode: simple
number of clients: 8
number of threads: 8
duration: 600 s
number of transactions actually processed: 433761
latency average = 11.065 ms
initial connection time = 39.044 ms
tps = 722.968423 (without initial connection time)### Iteration 1: 12 jobs, 12 clients
scaling factor: 5000
query mode: simple
number of clients: 12
number of threads: 12
duration: 600 s
number of transactions actually processed: 558265
latency average = 12.896 ms
initial connection time = 55.670 ms
tps = 930.495133 (without initial connection time)### Iteration 2: 4 jobs, 4 clients
scaling factor: 5000
query mode: simple
number of clients: 4
number of threads: 4
duration: 600 s
number of transactions actually processed: 264303
latency average = 9.080 ms
initial connection time = 22.646 ms
tps = 440.514577 (without initial connection time)### Iteration 2: 8 jobs, 8 clients
scaling factor: 5000
query mode: simple
number of clients: 8
number of threads: 8
duration: 600 s
number of transactions actually processed: 428963
latency average = 11.189 ms
initial connection time = 61.718 ms
tps = 714.993935 (without initial connection time)### Iteration 2: 12 jobs, 12 clients
scaling factor: 5000
query mode: simple
number of clients: 12
number of threads: 12
duration: 600 s
number of transactions actually processed: 557441
latency average = 12.915 ms
initial connection time = 57.655 ms
tps = 929.127492 (without initial connection time)### Iteration 3: 4 jobs, 4 clients
query mode: simple
number of clients: 4
number of threads: 4
duration: 600 s
number of transactions actually processed: 265271
latency average = 9.047 ms
initial connection time = 21.618 ms
tps = 442.128341 (without initial connection time)### Iteration 3: 8 jobs, 8 clients
scaling factor: 5000
query mode: simple
number of clients: 8
number of threads: 8
duration: 600 s
number of transactions actually processed: 433392
latency average = 11.075 ms
initial connection time = 39.829 ms
tps = 722.355663 (without initial connection time)### Iteration 3: 12 jobs, 12 clients
scaling factor: 5000
query mode: simple
number of clients: 12
number of threads: 12
duration: 600 s
number of transactions actually processed: 549315
latency average = 13.107 ms
initial connection time = 54.778 ms
tps = 915.569175 (without initial connection time)### Iteration 4: 4 jobs, 4 clients
scaling factor: 5000
query mode: simple
number of clients: 4
number of threads: 4
duration: 600 s
number of transactions actually processed: 267359
latency average = 8.976 ms
initial connection time = 25.396 ms
tps = 445.610859 (without initial connection time)### Iteration 4: 8 jobs, 8 clients
scaling factor: 5000
query mode: simple
number of clients: 8
number of threads: 8
duration: 600 s
number of transactions actually processed: 433075
latency average = 11.083 ms
initial connection time = 38.146 ms
tps = 721.814897 (without initial connection time)### Iteration 4: 12 jobs, 12 clients
scaling factor: 5000
query mode: simple
number of clients: 12
number of threads: 12
duration: 600 s
number of transactions actually processed: 551536
latency average = 13.054 ms
initial connection time = 57.123 ms
tps = 919.270818 (without initial connection time)---
## RDS
### Iteration 1: 4 jobs,4 clients
scaling factor: 5000
query mode: simple
number of clients: 4
number of threads: 4
duration: 600 s
number of transactions actually processed: 490713
latency average = 4.891 ms
initial connection time = 21.956 ms
tps = 817.880615 (without initial connection time)### Iteration 1: 8 jobs, 8 clients
scaling factor: 5000
query mode: simple
number of clients: 8
number of threads: 8
duration: 600 s
number of transactions actually processed: 541273
latency average = 8.868 ms
initial connection time = 38.660 ms
tps = 902.133131 (without initial connection time)### Iteration 1: 12 jobs, 12 clients
scaling factor: 5000
query mode: simple
number of clients: 12
number of threads: 12
duration: 600 s
number of transactions actually processed: 485587
latency average = 14.841 ms
initial connection time = 69.148 ms
tps = 808.553664 (without initial connection time)### Iteration 2: 4 jobs, 4 clients
scaling factor: 5000
query mode: simple
number of clients: 4
number of threads: 4
duration: 600 s
number of transactions actually processed: 46225
latency average = 51.952 ms
initial connection time = 22.243 ms
tps = 76.994356 (without initial connection time)### Iteration 2: 8 jobs, 8 clients
scaling factor: 5000
query mode: simple
number of clients: 8
number of threads: 8
duration: 600 s
number of transactions actually processed: 50419
latency average = 95.199 ms
initial connection time = 43.627 ms
tps = 84.034334 (without initial connection time)### Iteration 2: 12 jobs, 12 clients
scaling factor: 5000
query mode: simple
number of clients: 12
number of threads: 12
duration: 600 s
number of transactions actually processed: 55617
latency average = 129.472 ms
initial connection time = 58.147 ms
tps = 92.684093 (without initial connection time)### Iteration 3: 4 jobs, 4 clients
scaling factor: 5000
query mode: simple
number of clients: 4
number of threads: 4
duration: 600 s
number of transactions actually processed: 39491
latency average = 60.774 ms
initial connection time = 22.850 ms
tps = 65.817365 (without initial connection time)### Iteration 3: 8 jobs, 8 clients
scaling factor: 5000
query mode: simple
number of clients: 8
number of threads: 8
duration: 600 s
number of transactions actually processed: 49588
latency average = 96.830 ms
initial connection time = 43.235 ms
tps = 82.618602 (without initial connection time)### Iteration 3: 12 jobs, 12 clients
query mode: simple
number of clients: 12
number of threads: 12
duration: 600 s
number of transactions actually processed: 54468
latency average = 132.208 ms
initial connection time = 59.354 ms
tps = 90.765844 (without initial connection time)### Iteration 4: 4 jobs, 4 clients
query mode: simple
number of clients: 4
number of threads: 4
duration: 600 s
number of transactions actually processed: 45062
latency average = 53.267 ms
initial connection time = 21.892 ms
tps = 75.093289 (without initial connection time)### Iteration 4: 8 jobs, 8 clients
scaling factor: 5000
query mode: simple
number of clients: 8
number of threads: 8
duration: 600 s
number of transactions actually processed: 61648
latency average = 77.872 ms
initial connection time = 59.096 ms
tps = 102.733042 (without initial connection time)### Iteration 4: 12 jobs, 12 clients
scaling factor: 5000
query mode: simple
number of clients: 12
number of threads: 12
duration: 600 s
number of transactions actually processed: 53857
latency average = 133.679 ms
initial connection time = 93.852 ms
tps = 89.767321 (without initial connection time)