Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/yugabytedb-samples/market-orders-app
Storing and processing real-time data streams with YugabyteDB
https://github.com/yugabytedb-samples/market-orders-app
demos distributed-database mysql postgresql pubnub streaming yugabytedb
Last synced: about 6 hours ago
JSON representation
Storing and processing real-time data streams with YugabyteDB
- Host: GitHub
- URL: https://github.com/yugabytedb-samples/market-orders-app
- Owner: YugabyteDB-Samples
- License: apache-2.0
- Created: 2022-03-23T13:48:25.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-05-21T18:39:01.000Z (6 months ago)
- Last Synced: 2024-05-22T19:06:25.089Z (6 months ago)
- Topics: demos, distributed-database, mysql, postgresql, pubnub, streaming, yugabytedb
- Language: Shell
- Homepage:
- Size: 238 KB
- Stars: 2
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Market Orders Streaming to YugabyteDB
The application subscribes to the [PubNub's market orders stream](https://www.pubnub.com/developers/realtime-data-streams/financial-securities-market-orders/) and stores the market trades in an underlying database. You can switch between MySQL, PostgreSQL and YugabyteDB with no need to update the application logic.
## Start Database
* Start a MySQL instance and load sample data:
```shell
docker-compose -f docker-compose-mysql.yml up
```
Use port `3307` for connections from the host machine.
* or start a PostgreSQL database instead:
```shell
docker-compose -f docker-compose-postgres.yml up
```
Use port `5438` for connections from the host machine.
* or start a [YugabyteDB Managed](https://docs.yugabyte.com/latest/yugabyte-cloud/cloud-quickstart/) instance, and load the schema (`./schema/schema_postgres.sql`) and sample data (`./schema/data.sql`).
## Build and run Java app
* Build and package the app:
```shell
mvn clean package
```
* Run the app by connecting to the selected database:
* Connect to Postgres (`./properties/postgres.properties`):
```shell
java -jar target/market-orders-app.jar connectionProps=./properties/postgres.properties loadScript=./schema/schema_postgres.sql tradeStatsInterval=2000
```
* Connect to MySQL (`./properties/mysql.properties`):
```shell
java -jar target/market-orders-app.jar connectionProps=./properties/mysql.properties loadScript=./schema/schema_mysql.sql tradeStatsInterval=2000
```
* Connect to YugabyteDB Managed after providing connecting settings in the `./properties/yugabyte-template.properties` file:
```shell
java -jar target/market-orders-app.jar connectionProps=./properties/yugabyte.properties loadScript=./schema/schema_postgres.sql tradeStatsInterval=2000
```
The `tradeStatsInterval` (measured in milliseconds) instructs the `TradeStats.java` service to query trade-related statistics from the database within the specified interval. If the interval is <= `0` or not set, then the statistics will not be collected.
## Advanced Demo
The app can be used to demonstrate the migration from PostreSQL/MySQL to YugabyteDB as well as high-avalability and scalability capabilities of YugabyteDB.
Follow [this page](./demo/demo_sript.md) for more details.
## Run in Docker
1. Build the app:
```shell
mvn clean package
```
2. Create an image:
```shell
docker rmi market-orders-app
docker build -t market-orders-app .
```
3. Start the app inside a container:
```shell
docker run --name market-orders-instance --net custom-network \
market-orders-app:latest \
java -jar /home/target/market-orders-app.jar \
connectionProps=/home/yugabyte-docker.properties \
loadScript=/home/schema_postgres.sql \
tradeStatsInterval=2000
```