https://github.com/arenadata/prostore
Data Lake Engine
https://github.com/arenadata/prostore
Last synced: 6 months ago
JSON representation
Data Lake Engine
- Host: GitHub
- URL: https://github.com/arenadata/prostore
- Owner: arenadata
- License: other
- Created: 2020-12-24T10:08:33.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2021-12-10T06:48:56.000Z (over 4 years ago)
- Last Synced: 2024-10-18T15:58:54.701Z (over 1 year ago)
- Language: Java
- Homepage:
- Size: 2.13 MB
- Stars: 13
- Watchers: 20
- Forks: 9
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: license-header.txt
Awesome Lists containing this project
README
# Prostore
Prostore is an open-source integration system providing a temporal DB unified interface to the heterogenous data store. It’s purposed for a datamart implementation.
## Useful links
[Documentation (Rus)](https://arenadata.github.io/docs_prostore/)
## Local deployment
The main prerequisites include git, Java and Apache Maven.
### The cloning and building of the Prostore repository
```shell script
# clone
git clone https://github.com/arenadata/prostore
# build without any tests
cd ~/prostore
mvn clean
mvn install -DskipTests=true
```
The resulting jar file is located in the `dtm-query-execution-core/target` folder.
### App configuration
The Prostore configuration file is located in the `dtm-query-execution-core/config` folder.
The Prostore application looks for the configuration in the same subfolder (target) where `dtm-query-execution-core-.jar` is executed.
So we create the respective symbolic link
```shell script
sudo ln -s ~/prostore/dtm-query-execution-core/config/application.yml ~/prostore/dtm-query-execution-core/target/application.yml
```
If no configuration file is located, then the Prostore application uses its internal default configuration.
### Run application
#### Run prerequisite obligatory supporting services
- Zookeeper,
- Kafka,
- set of respective DBMS,
- kafka-DBMS connectors (e.g. see [kafka-postgres-connector](https://github.com/arenadata/kafka-postgres-connector)),
- [Prostore status monitor](https://github.com/arenadata/prostore/tree/master/dtm-status-monitor).
#### Run main service as a single jar on the default port 8080
```shell script
cd ~/prostore/dtm-query-execution-core/target
java -jar dtm-query-execution-core-.jar
```
#### Change default port to run Prostore
- change the value of the key `server:port` in the configuration file or `DTM_METRICS_PORT` environment variable
## Setup JDBC test client
Use [DTM JDBC driver](dtm-jdbc-driver/README.md).
URL is `jdbc:adtm://:/`:
- `host` is host of dtm-query-execution-core (`localhost`)
- `port` is port of dtm-query-execution-core (see actual `application.yml` for dtm-query-execution-core)
See also [connection with JDBC-client (Rus)](https://arenadata.github.io/docs_prostore/working_with_system/connection/connection_via_sql_client/connection_via_sql_client.html)