https://github.com/porte-bleue/mongo-to-postgres-etl

Set up a Cost-Effective Modern Data Stack for a Charity
https://github.com/porte-bleue/mongo-to-postgres-etl

analytics-platform analytics-stack charity data-for-good dbt modern-data-stack mongodb mongodb-database postgresql-database prefect preset python

Last synced: 4 months ago
JSON representation

Set up a Cost-Effective Modern Data Stack for a Charity

• Host: GitHub
• URL: https://github.com/porte-bleue/mongo-to-postgres-etl
• Owner: Porte-Bleue
• Created: 2022-01-23T18:15:00.000Z (about 3 years ago)
• Default Branch: main
• Last Pushed: 2024-02-26T11:12:13.000Z (12 months ago)
• Last Synced: 2024-10-10T05:41:14.703Z (4 months ago)
• Topics: analytics-platform, analytics-stack, charity, data-for-good, dbt, modern-data-stack, mongodb, mongodb-database, postgresql-database, prefect, preset, python
• Language: Python
• Homepage:
• Size: 12.9 MB
• Stars: 18
• Watchers: 1
• Forks: 1
• Open Issues: 1
• Metadata Files:
  • Readme: Readme.md

Awesome Lists containing this project

README

        
# Analytics La Porte Bleue

> Modern Data Stack for a Charity

Get started with a cost-effective modern data stack using this repo. 

Read more about the project in my blog post [here]().

This repo helps bootstrap the infrastructure of a charity's modern data stack known as La Porte Bleue.

## Architecture

![](data_stack_diagram.png)

1. Ingestion: **Python** (PyMongo & SQLModel)

2. Orchestration: **Prefect**

3. Warehousing: **Heroku Postgres**

4. Transform: **dbt**

5. Business Intelligence: **Preset**