Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/dinel13/thesis-ac
Compare the performance of microservice use gRPC and REST APIs for academic management system
https://github.com/dinel13/thesis-ac
datadog ec2 golang grpc jmeter k6 microservice nodejs redis
Last synced: 6 days ago
JSON representation
Compare the performance of microservice use gRPC and REST APIs for academic management system
- Host: GitHub
- URL: https://github.com/dinel13/thesis-ac
- Owner: Dinel13
- Created: 2021-10-25T11:11:35.000Z (about 3 years ago)
- Default Branch: pepper
- Last Pushed: 2022-07-24T05:38:36.000Z (over 2 years ago)
- Last Synced: 2023-07-12T12:05:58.033Z (over 1 year ago)
- Topics: datadog, ec2, golang, grpc, jmeter, k6, microservice, nodejs, redis
- Language: Go
- Homepage:
- Size: 233 MB
- Stars: 3
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Thesis-ac
My bachelor thesis in [Hasanuddin University](https://unhas.ac.id/v2/) as an Informatics Engineer Student.
## Table of contents
- [General info](#general-info)
- [Technologies](#technologies)
- [Run service](#run-service)
- [Run test](#run-test)
- [Result](#result)
## General info
The main purpose of this thesis is to **Compare the performance of microservice use gRPC and REST APIs for academic management system**. So this project has 3 services:
1. **KRS Service** use golang.
2. **Auth Service** uses nodejs and also golang.
3. **Payment Service** use golang.
To store data in the database, I use **Redis**. Then use **k6** to test the performance of each service and use **Datadog** to monitor the performance. Additionaly i also try use **Jmeter** to load test. All the services are deployed in different **EC2 AWS** as well as the test agent then use private IP to communicate.
### System design
**New design**
![sistem design[new]](https://github.com/dinel13/thesis-ac/blob/main/design-new.jpg?raw=true)
**Old design**
![sistem design[old]](https://github.com/dinel13/thesis-ac/blob/main/design.jpg?raw=true)
## Technologies
- **Golang 1.17.1**
- **Nodejs 4.17.6**
- **Redis 5.0.7**
- **EC2 AWS**
- **K6**
- **Datadog 0.36.0**
- **Jmeter 5.4.1**
- **Linux ubuntu 20.4**
## Run service
### 1. **KRS Service**
```bash
$ IP_AUTH=localhost IP_PAYMENT=localhost IP_REDIS=localhost KRS-service/main
```
### 2. **Auth Service**
#### Use nodejs
```bash
$ cd auth-service-nodejs && npm install && IP_REDIS=localhost npm start
```
#### Use golang
```bash
$ IP_REDIS=localhost auth-service-go/main
```
### 3. **Payment Service** use golang.
```bash
$ IP_REDIS=localhost payment-service/main
```
## Run test
run the cpu watch tool to watch the cpu usage.
```bash
$ cpu-watch-tool/main -p -o
```
### 1. **RUN proxy Service**
```bash
$ IP_KRS=localhost IP_AUTH=localhost IP_PAYMENT=localhost proxy/main
```
### 1. Use K6
#### Run DataDog agent
```bash
DOCKER_CONTENT_TRUST=1 \
sudo docker run -d \
--name datadog \
-v /var/run/docker.sock:/var/run/docker.sock:ro \
-v /proc/:/host/proc/:ro \
-v /sys/fs/cgroup/:/host/sys/fs/cgroup:ro \
-e DD_SITE="datadoghq.com" \
-e DD_API_KEY= \
-e DD_DOGSTATSD_NON_LOCAL_TRAFFIC=1 \
-p 8125:8125/udp \
datadog/agent:latest
```
Don't forget to replace __ with your datadog api key
#### Run test use K6
All test files for K6 are in **k6** directory. For example, if you want to test grpc-krs-create in 100 vurtual user in 30 second use the command below.
```bash
K6_STATSD_ENABLE_TAGS=true k6 run --vus 100 --durations 30s --out statsd --tag test_run_id=1 -e IP=172.31.30.48 k6/grpc/krs/create.js
```
### 2. Use Jmeter
#### Run proxy service
Proxy service use to transform from rest to grpc and carry on rest to rest. So we can use jmeter to test the performance both for grpc and rest.
```bash
$ IP_KRS=127.0.0.1 IP_AUTH=127.0.0.1 IP_PAYMENT=127.0.0.1 test/main
```
or use the command below to automate laod test.
```bash
$ test-tools/main -j=/home/din/Downloads/apache-jmeter-5.4.1/bin/jmeter -m="test" ./jmx/1000 ./result/1000
```
#### Run test use JMeter
All jmx test file for Jmeter are in **jmx** directory. For example, if you want to test grpc-krs-create in 100 thread second use the command below.
```bash
jmeter.sh -n -t jmx/100/grpc-krs-create.jmx -l testresults.jtl
```
### 3. Use Locust
Still developing...
## Result
### Result for test use Apache JMeter
**Response Time**
**Throughput**
**CPU Utilization**
### Result for K6 with 100 vurtual user in 30 second
**Grpc**
**Rest**
**Datadog**
