https://github.com/datarecce/recce
The data-validation toolkit for enhanced dbt (data build tool) PR review
https://github.com/datarecce/recce
analytics-engineering data data-engineering data-validation dataops dbt elt
Last synced: 4 days ago
JSON representation
The data-validation toolkit for enhanced dbt (data build tool) PR review
- Host: GitHub
- URL: https://github.com/datarecce/recce
- Owner: DataRecce
- License: apache-2.0
- Created: 2023-10-06T08:14:25.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2026-04-08T11:29:01.000Z (9 days ago)
- Last Synced: 2026-04-08T11:32:11.121Z (9 days ago)
- Topics: analytics-engineering, data, data-engineering, data-validation, dataops, dbt, elt
- Language: TypeScript
- Homepage: https://datarecce.io/docs
- Size: 49.8 MB
- Stars: 450
- Watchers: 7
- Forks: 26
- Open Issues: 24
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Security: SECURITY.md
- Agents: AGENTS.md
Awesome Lists containing this project
README
Helping data teams preview, validate, and ship data changes with confidence.
## Trust, Verify, Ship
Cut dbt review time by 90% and ship accurate data fast
Recce gives data teams a faster, more reliable way to understand, review, and ship changes without all the guesswork or manual overhead.
## Quick Start
### Installation
Recce offers two packages to fit different use cases:
**For full local development and Recce Cloud features:**
```bash
pip install -U recce
recce server
```
**For CI/CD artifact uploads only (lightweight):**
```bash
pip install -U recce-cloud
recce-cloud upload
```
The `recce-cloud` package is a lightweight CLI tool designed specifically for CI/CD environments where you only need to upload dbt artifacts to Recce Cloud. It has minimal dependencies and installs faster than the full `recce` package.
### Getting Started
You can launch Recce in any dbt project in just two commands:
```bash
# cd into your dbt project
pip install -U recce
recce server
```
(Note: while recce is not version spsecific, `dbt-core` is currently [not compatible with Python 3.13](https://docs.getdbt.com/faqs/Core/install-python-compatibility). Please make sure to use Python 3.10 - 3.12.)
This starts Recce locally, where you can explore lineage and run queries. To unlock the full set of diffing tools, such as data comparisons and impact checks, you'll need to prepare two environments to compare against. You can follow our [Getting Started](https://docs.reccehq.com/get-started/) and [5-minute Jaffle Shop tutorial](https://docs.reccehq.com/get-started-jaffle-shop/) to try it out step-by-step.
## What You Get
Recce gives you a clear, fast way to understand what your data changes are doing and why they matter. It helps you catch problems early, verify metrics, and share your findings with others, all as part of your normal workflow.
### Using Recce for Impact Assessment in dbt PR Review
- Select nodes in the lineage to perform Checks (diffs) as part of your impact assessment during development or PR
review.
- Add Checks to your Checklist to note observed impacts.
- Share your Checklist with the PR reviewer.
- (`Recce Cloud`) Automatically sync Check status between Recce Instances
- (`Recce Cloud`) Block PR merging until all Recce Checks have been approved
Read more about using Recce on our [blog](https://blog.reccehq.com).
### What’s Included
- [Lineage and impact mapping](https://docs.reccehq.com/features/lineage/): Quickly see which models and columns are affected by a change. Navigate lineage down to the column level, and spot breaking changes with clear visual cues.
- Metric and data comparisons: Use [Profile, Value, Top-K, and Histogram Diffs](https://docs.reccehq.com/features/lineage/#node-details) to compare results before and after changes. Validate things like row counts, category distributions, and numeric ranges without writing extra SQL.
- [Query diff](https://docs.reccehq.com/features/query/): Write and compare any two queries side by side. This is helpful when validating fixes or reviewing changes with teammates.
- [Checklist for reviews and approvals](https://docs.reccehq.com/features/checklist/): Turn your validation steps into a checklist. Add notes, rerun checks, and share the results with reviewers or stakeholders. In Recce Cloud, checklists can sync automatically and even block PRs until checks are approved.
- Secure by design: Recce is [SOC 2 compliant](https://trust.reccehq.com/) to meet enterprise security standards. It runs locally or in your private environment, and your data stays in your warehouse.
👉 Want to dive deeper? Check out the [full documentation](https://docs.reccehq.com/).
## Recce Cloud
Ready to collaborate and move faster as a team? Recce Cloud adds real-time collaboration, automatic checklist sync, and PR gating, so nothing gets merged without a full review.
- Share checklists across environments
- Invite stakeholders to review data changes
- Block merges until all Checks are approved
- Launch demo links from your CI with full context
Recce Cloud is a hosted version of Recce that standardizes your workflow, keeps teams aligned, and reduces errors—so you can ship data changes with confidence.
👉 [View Pricing and Plans](https://reccehq.com/pricing)
## Developer Documentation
If you want to contribute to Recce or test local changes in your dbt project, follow these steps to install the development version.
### Installing the Local Dev Version
1. **Clone the repository** (if you haven't already):
```bash
git clone https://github.com/DataRecce/recce.git
cd recce
```
2. **Build the project** from the repository root:
```bash
make build
```
This builds the frontend assets and prepares the package for installation.
3. **Install the local dev version** in your dbt project:
```bash
# Navigate to your dbt project
cd /path/to/your/dbt-project
# Install recce in editable mode (replace with your actual path to the recce repo)
pip install -e /path/to/recce
```
Using `-e` (editable mode) means any changes you make to the Recce source code will be immediately available without reinstalling.
4. **Start the Recce server** to verify the installation:
```bash
recce server
```
### Development Tips
- After making frontend changes in `js/`, run `make build` again to rebuild the static assets
- Run `make install-dev` in the recce repository to install development dependencies
- Use `make test` to run the Python test suite
- Use `cd js && pnpm test` to run the frontend test suite
For more detailed development guidelines, see [CONTRIBUTING.md](CONTRIBUTING.md).
## Community & Support
Here's where you can get in touch with the Recce team and find support, add a subscribe to our newsletter option as well:
- [chat on our website](https://reccehq.com/). We welcome you to start a chat or drop us a note. Our team monitors the chat box and will follow up soon.
- [Our discord](https://discord.com/invite/VpwXRC34jz)
- [dbt Slack](https://www.getdbt.com/community/join-the-community) in the [#tools-recce](https://getdbt.slack.com/archives/C05C28V7CPP) channel
- Email us [help@reccehq.com](mailto:help@reccehq.com)
If you believe you have found a bug on our open source, or there is some missing functionality in Recce, please open a [GitHub Issue](https://github.com/DataRecce/recce/issues).
## Recce on the web
You can follow along with news about Recce and blogs from our team in the following places:
- [RecceHQ.com](https://reccehq.com/)
- [LinkedIn](https://www.linkedin.com/company/datarecce)
- [Blog](https://blog.reccehq.com/)
- [@datarecce](https://x.com/DataRecce) on Twitter/X
- [@DataRecce@mastodon.social](https://mastodon.social/@DataRecce) on Mastodon
- [@datarecce.bsky.social](https://bsky.app/profile/datarecce.bsky.social) on BlueSky