Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/yugabytedb-samples/yb-workload-simulator
Extensible workload application for YugabyteDB.
https://github.com/yugabytedb-samples/yb-workload-simulator
Last synced: about 6 hours ago
JSON representation
Extensible workload application for YugabyteDB.
- Host: GitHub
- URL: https://github.com/yugabytedb-samples/yb-workload-simulator
- Owner: YugabyteDB-Samples
- License: apache-2.0
- Created: 2022-09-16T03:12:44.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-02-15T17:33:47.000Z (9 months ago)
- Last Synced: 2024-02-15T18:44:44.929Z (9 months ago)
- Language: Java
- Homepage:
- Size: 36.7 MB
- Stars: 5
- Watchers: 66
- Forks: 4
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# YB Workload Simulator application
YB Workload Simulator is a Java application that simulates workloads against YugabyteDB and provides live metrics of latency and throughput from the application's point of view. You can create/drop tables for a workload, load data, run different simulations from the application UI. You can view latency and throughput metrics in real time for your YugabyteDB cluster when the simulations are running. This repository acts as a base and you can extend it to write your specific simulations.
## Table of contents
* [Download the jar](#download-the-jar)
* [Run the application locally](#run-the-application-locally)
* [Run the application on a YugabyteDB Managed cluster](#run-the-application-on-a-yugabytedb-managed-cluster)
* [Code setup and Installation](#code-setup-and-installation)
* [Build the jar file](#build-the-jar-file)
* [Additional parameters for YCQL workloads](#additional-parameters-for-ycql-workloads)
* [How to build your own workload](#how-to-build-your-own-workload)
* [Start a read and write workload](#start-a-read-and-write-workload)
* [Create your own workload .java file](#create-your-own-workload-java-file)
## Download the jar
YB Workload Simulator requires Java 19 or later installed on your computer. JDK installers for Linux and macOS can be downloaded from [Oracle](http://jdk.java.net/), [Adoptium (OpenJDK)](https://adoptium.net/), or [Azul Systems (OpenJDK)](https://www.azul.com/downloads/?package=jdk). Homebrew users on macOS can install using `brew install openjdk`.
Download the latest YB Workload Simulator JAR file from the [releases](https://github.com/YugabyteDB-Samples/yb-workload-simulator/releases) page.
### Run the application locally
To run the application locally, do the following:
1. Install a local YugabyteDB cluster. Refer to [Set up your YugabyteDB cluster](https://docs.yugabyte.com/preview/explore/#set-up-your-yugabytedb-cluster) to start a local 3 node custer.
1. To start the application against a running local cluster, use the following command:
```sh
java -jar ./yb-workload-sim-0.0.2.jar
```
By default, the application connects to a local YugabyteDB cluster at 127.0.0.1.
To connect to a different address or node, use the `-Dnode` flag to specify an IP address. For example:
```sh
java -Dnode=127.0.0.2 -jar ./yb-workload-sim-0.0.2.jar
```
1. To view the application UI, navigate to `http://localhost:8080`.
You can pass additional parameters as needed:
```sh
java -DXmx=16g
-Dmax-pool-size=10
-Dnode=
-Ddbuser=
-Ddbpassword=
-Dspring.datasource.hikari.data-source-properties.topologyKeys=
-Dspring.workload=genericWorkload
-jar yb-workload-sim-0.0.2.jar
```
The parameters you can add to the java command are as follows:
```sh
-Dnode= [default: 127.0.0.1]
-Ddbuser= [default: yugabyte]
-Ddbpassword= [default: yugabyte]
-Dport= [default: 5433 - database port if using other than 5433]
-Dmax-pool-size= [default: 100]
-Ddbname= [default: yugabyte]
-Dworkload= [ default: genericWorkload ]
-Dspring.datasource.hikari.data-source-properties.topologyKeys= [ex. aws.us-east-2.us-east-2a,aws.us-east-2.us-east-2b,aws.us-east-2.us-east-2c]
-Dspring.profiles.active= [default: application.yaml]
-Dserver.port= [default: 8080]
-Dssl=true [default: false]
-Dsslmode=verify-full [default: disable]
-Dsslrootcert=
```
### Run the application on a YugabyteDB Managed cluster
1. To connect the application to your cluster, ensure that you have downloaded the cluster SSL certificate and your computer is added to the IP allow list. Refer to [Before you begin](https://docs.yugabyte.com//preview/develop/build-apps/cloud-add-ip/).
1. To start the application against a running YugabyteDB Managed cluster, use the following command:
```sh
java -Dnode= \
-Ddbname= \
-Ddbuser= \
-Ddbpassword= \
-Dssl=true \
-Dsslmode=verify-full \
-Dsslrootcert= \
-jar ./yb-workload-sim-0.0.2.jar
```
Replace the following:
* `host name` - the host name of your YugabyteDB cluster. For YugabyteDB Managed, select your cluster on the Clusters page, and click Settings. The host is displayed under Connection Parameters.
* `dbname` - the name of the database you are connecting to (the default is yugabyte).
* `dbuser` and `dbpassword` - the username and password for the YugabyteDB database. Use the credentials in the credentials file you downloaded when you created your cluster.
* `path-to-cluster-certificate` with the path to the cluster certificate on your computer.
1. To view the application UI, navigate to `http://localhost:8080`.
Additional parameters for YugabyteDB Managed to start/stop nodes and scale cluster can be provided in UI by clicking settings gear option on right hand side.
## Code setup and Installation
### Build the jar file
From the root of the project run the following maven command:
```sh
mvn clean package -DskipTests
```
A jar file gets created at : /target/yb-workload-simulator.jar. You can [run the application locally](https://github.com/YugabyteDB-Samples/yb-workload-simulator/edit/main/README.md#run-the-application-locally) using [YugabyteDB Managed](#run-the-application-on-a-yugabytedb-managed-cluster) using the jar.
#### Additional parameters for YCQL workloads
```sh
-Dworkload=genericCassandraWorkload
-Dspring.data.cassandra.contact-points=
-Dspring.data.cassandra.port=9042
-Dspring.data.cassandra.local-datacenter= [ex. us-east-2 ]
-Dspring.data.cassandra.userid=cassandra
-Dspring.data.cassandra.password=
-Dspring.data.cassandra.sslcertpath= [ex. /Users/username/root.crt]
```
## How to build your own workload
1. Download the latest archive from the [releases](https://github.com/YugabyteDB-Samples/yb-workload-simulator/releases) page and unzip the file.
1. From the root of your project run the following maven command:
```sh
./mvnw spring-boot:run -Dspring-boot.run.profiles=dev
```
A jar file gets created at `/target/yb-simu-base-app.jar`
You can also get the jar file in VS Code by right clicking the "WorkloadSimulationApplication.java" file and selecting Run Java.
Verify the name of the jar file in the target directory, and use the name of that file wherever you see `yb-workload-sim-0.0.2.jar`.
## Start a read and write workload
To view the application UI, navigate to
1. In the application UI, click the hamburger icon at the top of the page beside **Active Workloads for Generic**.
1. Select the **Usable Operations** tab.
1. Under **Create Tables**, click **Run Create Tables Workload** to add tables to the database.
1. Under **Seed Data**, click **Run Seed Data Workload** to add data to the tables.
1. Under **Simulation**, select the **Include new Inserts** option, and click **Run Simulation Workload**.
1. Click **Close**.
The Latency and Throughput charts show the workload running on the cluster.
## Create your own workload .java file
To create your workload file, do the following:
1. Copy the `GenericWorkload.java` file into a file with a new name. The file in this example is named "InstructionsWorkload.java".
There are 3 "FIX ME" sections to change the name of the class after you copy and paste the "GenericWorkload.java" file.
1. To be able to call the new workload, you have to modify the `WorkloadConfig.java` file in [src/main/java/com/yugabyte/simulation/config/](src/main/java/com/yugabyte/simulation/config/).
1. Run the "WorkloadSimulationApplication.java" as a java file.
A new "jar" file gets created in your target directory.
1. You should be able to run the code with the following command (code from line 136 above):
1. Navigate to and you will see the IP address of the machine you are using:
