https://github.com/davidgasquez/grants-data-portal

🌲 Open source, serverless, and local-first Data Platform for Public Goods Grants Data.
https://github.com/davidgasquez/grants-data-portal

dbt duckdb gitcoin

Last synced: 12 months ago
JSON representation

🌲 Open source, serverless, and local-first Data Platform for Public Goods Grants Data.

• Host: GitHub
• URL: https://github.com/davidgasquez/grants-data-portal
• Owner: davidgasquez
• License: mit
• Created: 2023-09-11T13:55:35.000Z (almost 3 years ago)
• Default Branch: main
• Last Pushed: 2025-05-28T18:35:39.000Z (about 1 year ago)
• Last Synced: 2025-07-04T17:17:17.076Z (12 months ago)
• Topics: dbt, duckdb, gitcoin
• Language: HTML
• Homepage: https://grantsdataportal.xyz
• Size: 757 KB
• Stars: 32
• Watchers: 2
• Forks: 4
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
࿂ Grants Data Portal ࿂




  

  

  

  



Open source, serverless, and local-first Data Platform for Public Goods Grants Data. This data hub improves data access and empower data scientists to conduct research that guides community driven analysis.

> [!IMPORTANT]

>

> The previous version of the portal (browse it [here](https://github.com/davidgasquez/grants-data-portal/tree/ea74827476e25fbc3f94aa052c15c7b681a2d183)) is **deprecated**. You can find better and more up to date data on [Open Source Observer](https://www.opensource.observer/). This new approach/version **focuses on curating Open Source Observer datasets with some smaller datasets** and distributing them.

## 📖 Overview

The repository contains code and artifacts to help process grants around the Public Goods Ecosystem. The portal is based on the principles of [Datadex](https://datadex.datonic.io/).

### 📦 Key Features

- **Open**: Code and data are open source and relies on open standards and formats.

- **Permissionless Collaboration**: Collaborate on data, models, and pipelines. Fork the repo and run the platform locally in minutes. No constraints or platform lock-ins.

- **Decentralization Options**: Runs on a laptop, server, CI runner, or even on decentralized compute networks like Bacalhau. No local setup required.

- **Data as Code**: Each commit generates and pushes all datasets as files to an Object Storage.

- **Modular Flexibility**: Replace, extend, or remove individual components. Compatible with tons of tools. At the end of the day, datasets are Parquet files.

- **Low Friction Data Usage**: Raw and processed data is available to anyone openly. Use whatever tool you want!

- **Modern Data Engineering**: Supports data engineering essentials such as typing, testing, materialized views, and development branches. Utilizes best practices, including declarative transformations, and utilizes state-of-the-art tools like DuckDB.

## ⚙️ Quick Start

Make sure you have [uv](https://docs.astral.sh/uv/getting-started/installation/) installed. Clone the repository and install dependencies:

```bash

git clone https://github.com/davidgasquez/grants-data-portal.git

cd grants-data-portal

make setup

```

Run the Dagster UI:

```bash

make dev

```

You can now access the Dagster UI at [http://localhost:3000](http://localhost:3000)!

## 🛠️ Contributing

This project is in active development. You can help by giving ideas, answering questions, reporting bugs, proposing enhancements, improving the documentation, and fixing bugs.

Some ways you can contribute to this project:

- Adding new data sources.

- Improving the data quality of existing datasets.

- Adding tests to the data pipelines.

### 📄 License

[MIT](https://choosealicense.com/licenses/mit/).