Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/bruin-data/bruin

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
https://github.com/bruin-data/bruin

analytics bigquery data-analysis data-modeling data-pipelines data-transformation python snowflake sql

Last synced: 9 days ago
JSON representation

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

Awesome Lists containing this project

README

        



Bruin is a data pipeline tool that brings together data ingestion, data transformation with SQL & Python, and data quality into a single framework. It works with all the major data platforms and runs on your local machine, an EC2 instance, or GitHub Actions.

Bruin CLI - Demo

Bruin is packed with features:
- 📥 ingest data with [ingestr](https://github.com/bruin-data/ingestr) / Python
- ✨ run SQL & Python transformations on [many platforms](https://bruin-data.github.io/bruin/#supported-platforms)
- 📐 table/view [materializations](https://bruin-data.github.io/bruin/assets/materialization.html), incremental tables
- 🐍 run Python in isolated environments using [uv](https://github.com/astral-sh/uv)
- 💅 built-in data quality checks
- 🚀 Jinja templating to avoid repetition
- ✅ validate pipelines end-to-end via dry-run
- 👷 run on your local machine, an EC2 instance, or [GitHub Actions](https://bruin-data.github.io/bruin/cicd/github-action.html)
- 🔒 secrets injection via environment variables
- [VS Code extension](https://bruin-data.github.io/bruin/vscode-extension/overview.html) for a better developer experience
- ⚡ written in Golang
- 📦 [easy to install](https://bruin-data.github.io/bruin/getting-started/introduction/installation.html) and use

## Installation

Please see the installation instructions [here](https://bruin-data.github.io/bruin/getting-started/introduction/installation.html).

## Community

Join our Slack community [here](https://join.slack.com/t/bruindatacommunity/shared_invite/zt-2dl2i8foy-bVsuMUauHeN9M2laVm3ZVg).





## Quickstart

Take a look at our quickstart guide [here](https://bruin-data.github.io/bruin/getting-started/introduction/quickstart.html).