An open API service indexing awesome lists of open source software.

https://github.com/varugasu/csv-pipeline


https://github.com/varugasu/csv-pipeline

Last synced: 3 months ago
JSON representation

Awesome Lists containing this project

README

          

# Simple DuckDB data pipeline

This project shows a simple data pipeline to run locally using DuckDB.

It also use the Medallion Architecture on the `lake` folder to reproduce buckets

## Setup

Install duckdb on https://duckdb.org/install

Run everything with:

```bash
make pipeline
```