https://github.com/fgregg/warehouse-etl

GitHub Template for a Warehouse ETL script
https://github.com/fgregg/warehouse-etl

Last synced: about 1 month ago
JSON representation

GitHub Template for a Warehouse ETL script

• Host: GitHub
• URL: https://github.com/fgregg/warehouse-etl
• Owner: fgregg
• License: mit
• Created: 2022-11-14T19:33:01.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2022-11-17T14:49:18.000Z (about 2 years ago)
• Last Synced: 2024-10-15T09:55:47.498Z (3 months ago)
• Size: 12.7 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Template for Warehouse ELT jobs.

* Source data files go in [raw](./raw)

* Any custom scripts go in [scripts](./scripts)

* Everything should build with a single `make` invocation.

* The README.md should create a link to or screenshot of the FOIA request

* The README shoud describe the data and have links to the generated database(s)

## Storing artifacts in a release.

Generated data should in a release. I typically, [create a release](https://docs.github.com/en/repositories/releasing-projects-on-github/managing-releases-in-a-repository#creating-a-release) called nightly. 

## To Build

```bash

> pip install -r requirements.txt

> make

```