https://github.com/activeviam/bd-poc-renre-directquery
https://github.com/activeviam/bd-poc-renre-directquery
Last synced: 7 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/activeviam/bd-poc-renre-directquery
- Owner: activeviam
- Created: 2024-06-11T15:25:12.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-08-03T03:30:34.000Z (almost 2 years ago)
- Last Synced: 2024-12-27T01:09:57.264Z (over 1 year ago)
- Language: Jupyter Notebook
- Size: 539 KB
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# bd-poc-renre-directquery
## Instructions
### Set up container
Follow the instructions [here](https://docs.dremio.com/current/get-started/docker-quickstart/) to install the Dremio docker container. Make sure to set up the user name and password in the container as follows:
```
username="admin"
password="admin01!"
```
In the top right, click the + button, and add the CSV in utilities/data from this repo.
Finally, to ensure the data types are all correct, run the below SQL:
```
SELECT TO_DATE(AsofDate, 'YYYY-MM-DD', 1) AS AsofDate,
CUSIP,
SectorCode,
Strategy,
CAST(MarketValue as DOUBLE) as MarketValue,
CAST(EffectiveDuration as DOUBLE) as EffectiveDuration,
CAST(OptionAdjustedSpread as DOUBLE) as OptionAdjustedSpread, LegalEntity, PortfolioTicker, OwnershipType,
CAST(PercentWeight as DOUBLE) as PercentWeight
FROM "@admin".SampleData20240104 AS SampleData20240104;
```
### Run Demo
Run the `CreateEnvironment.sh` script to install the experimental version of the python API that supports a generic JDBC connector. This uses a Dremio Dialect JAR that is in `utilities/extra_jars`.
Finally, you will need to download the Dremio JDBC driver [here](https://www.dremio.com/drivers/jdbc/).
After this, you should be able to run `StartDemo.sh` to start the environment in Jupyter Lab. There are two notebooks, a DQ version and an in-memory version, pulling from the same table.