https://github.com/jackdbd/open-data-projects
https://github.com/jackdbd/open-data-projects
Last synced: 8 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/jackdbd/open-data-projects
- Owner: jackdbd
- Created: 2024-08-11T18:48:04.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-08-14T12:07:06.000Z (almost 2 years ago)
- Last Synced: 2025-01-17T21:29:36.506Z (over 1 year ago)
- Language: Python
- Size: 68.4 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# NYC Open Data to DuckDB
## Useful commands
This project can be managed with a few [Babashka tasks](https://book.babashka.org/#tasks) and [Devenv scripts](https://devenv.sh/scripts/).
Fetch data from NYC Open Data and ingest it into DuckDB:
```sh
ingestion
```
Run dbt run in a dlt pipeline:
```sh
transformation
```
Build dbt docs:
```sh
docs-build
```
Serve dbt docs:
```sh
docs-serve
```