https://github.com/infuseai/git-repo-analytics
https://github.com/infuseai/git-repo-analytics
Last synced: 7 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/infuseai/git-repo-analytics
- Owner: InfuseAI
- Created: 2023-01-11T07:28:37.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2023-09-07T07:24:15.000Z (over 2 years ago)
- Last Synced: 2025-08-11T22:41:13.894Z (8 months ago)
- Language: Python
- Size: 3.12 MB
- Stars: 7
- Watchers: 6
- Forks: 3
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Introduction
This is a demo project for [PipeRider](https://github.com/InfuseAI/piperider). It shows how you can use [dbt](https://www.getdbt.com/)+[duckdb](https://duckdb.org/)+[PipeRider](https://github.com/InfuseAI/piperider) to transform and query data efficiently. With these tools, you can generate a report that gives you insights into your git projects.
# Usage
1. Clone this repo
```
git clone git@github.com:InfuseAI/git-repo-analytics.git
```
1. Prepare git repositories repo for analysis by editing the `repos.csv`
The format of the `repos.csv` file is as follows:
```
name,repo
dbt-core,dbt-labs/dbt-core
duckdb,duckdb/duckdb
PipeRider,InfuseAI/piperider
```
1. Install python package
```
python -m venv ./venv
source ./venv/bin/activate
pip install -r requirements.txt
```
1. Generate the db file from the repo.
```
make fetch
make load
```
The file `git_repo.duckdb` is generated under `./data`
1. Run dbt
```
make transform
```
1. Generate report
```
make report
```
1. Run piperider
```
make piperider
```
You can either run step-by-step from step4 to step7 or simply do one command
```
make
```
# Screenshots
