https://github.com/bruin-data/bruin
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
https://github.com/bruin-data/bruin
analytics bigquery data-analysis data-ingestion data-modeling data-pipelines data-platform data-transformation python snowflake sql
Last synced: 10 days ago
JSON representation
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
- Host: GitHub
- URL: https://github.com/bruin-data/bruin
- Owner: bruin-data
- License: apache-2.0
- Created: 2023-08-03T12:32:10.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2025-05-14T11:42:35.000Z (11 days ago)
- Last Synced: 2025-05-14T11:49:30.483Z (10 days ago)
- Topics: analytics, bigquery, data-analysis, data-ingestion, data-modeling, data-pipelines, data-platform, data-transformation, python, snowflake, sql
- Language: Go
- Homepage: https://bruin-data.github.io/bruin/
- Size: 69.6 MB
- Stars: 938
- Watchers: 8
- Forks: 37
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE.md
- Security: SECURITY.md
Awesome Lists containing this project
- awesome-github-repos - bruin-data/bruin - Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows. (Go)
README
Bruin is a data pipeline tool that brings together data ingestion, data transformation with SQL & Python, and data quality into a single framework. It works with all the major data platforms and runs on your local machine, an EC2 instance, or GitHub Actions.
Bruin is packed with features:
- 📥 ingest data with [ingestr](https://github.com/bruin-data/ingestr) / Python
- ✨ run SQL & Python transformations on [many platforms](https://bruin-data.github.io/bruin/#supported-platforms)
- 📐 table/view [materializations](https://bruin-data.github.io/bruin/assets/materialization.html), incremental tables
- 🐍 run Python in isolated environments using [uv](https://github.com/astral-sh/uv)
- 💅 built-in data quality checks
- 🚀 Jinja templating to avoid repetition
- ✅ validate pipelines end-to-end via dry-run
- 👷 run on your local machine, an EC2 instance, or [GitHub Actions](https://bruin-data.github.io/bruin/cicd/github-action.html)
- 🔒 secrets injection via environment variables
- [VS Code extension](https://bruin-data.github.io/bruin/vscode-extension/overview.html) for a better developer experience
- ⚡ written in Golang
- 📦 [easy to install](https://bruin-data.github.io/bruin/getting-started/introduction/installation.html) and use
## Installation
Please see the installation instructions [here](https://bruin-data.github.io/bruin/getting-started/introduction/installation.html).
## Community
Join our Slack community [here](https://join.slack.com/t/bruindatacommunity/shared_invite/zt-2dl2i8foy-bVsuMUauHeN9M2laVm3ZVg).
## Quickstart
Take a look at our quickstart guide [here](https://bruin-data.github.io/bruin/getting-started/introduction/quickstart.html).