Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with data-lineage

A curated list of projects in awesome lists tagged with data-lineage .

https://github.com/open-metadata/openmetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

data-catalog data-collaboration data-contracts data-discovery data-governance data-lineage data-observability data-profiling data-quality data-quality-checks data-science data-validation datadiscovery dataengineering dataquality dbt hacktoberfest metadata metadata-management snowflake

Last synced: 22 Feb 2026

https://github.com/open-metadata/OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

data-catalog data-collaboration data-contracts data-discovery data-governance data-lineage data-observability data-profiling data-quality data-quality-checks data-science data-validation datadiscovery dataengineering dataquality dbt hacktoberfest metadata metadata-management snowflake

Last synced: 15 Mar 2025

https://github.com/elementary-data/elementary

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

analytics-engineer bigquery data-analysis data-governance data-lineage data-observability data-pipeline data-pipelines data-reliability data-warehouse dataops dbt dbt-artifacts dbt-packages lineage redshift snowflake

Last synced: 19 May 2026

https://github.com/reata/sqllineage

SQL Lineage Analysis Tool powered by Python

data-discovery data-governance data-lineage lineage metadata sql

Last synced: 14 May 2025

https://github.com/marmotdata/marmot

Marmot helps teams discover, understand, and leverage their data with powerful search and lineage visualisation tools. It's designed to make data accessible for everyone.

bigdata data-catalog data-collaboration data-discovery data-exploration data-governance data-lineage data-observability datacatalog datadiscovery dataengineering lineage mcp mcp-server metadata

Last synced: 09 Apr 2026

https://github.com/elementary-data/dbt-data-reliability

dbt package that is part of Elementary, the dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

analytics analytics-engineering data data-lineage data-observability data-pipeline-monitoring data-pipelines data-reliability dbt dbt-artifacts dbt-packages dbt-tests

Last synced: 16 May 2025

https://github.com/tokern/data-lineage

Generate and Visualize Data Lineage from query history

data-governance data-lineage jupyter postgresql python

Last synced: 04 Apr 2025

https://github.com/rocky-data/rocky

The typed graph between your code and whichever warehouse, table format, or query engine you've chosen — typed compiler, branches, replay, column-level lineage, compile-time contracts, per-model cost. Adapters: Databricks, Snowflake, BigQuery, DuckDB. Single static Rust binary. Apache 2.0.

column-lineage dagster data-contracts data-engineering data-lineage data-pipeline data-platform data-quality dbt-alternative rust schema-drift sql

Last synced: 06 Jun 2026

https://github.com/googlecloudplatform/bigquery-data-lineage

Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.

bigdata bigquery data-catalog data-governance data-lineage data-management dataflow zetasql

Last synced: 20 Oct 2025

https://github.com/slidoapp/dbt-superset-lineage

Make dbt docs and Apache Superset talk to one another

cli data-lineage dbt lineage superset tool

Last synced: 30 Dec 2025

https://github.com/maropu/spark-sql-flow-plugin

Visualize column-level data lineage in Spark SQL

data-lineage graph graphviz neo4j python scala spark sql visualization

Last synced: 25 Jun 2025

https://github.com/montara-io/dbt-command-center

Never sift through endless dbt™ logs again. dbt Command Center is a free, open-source, local web application that provides a user-friendly interface to monitor and manage dbt runs.

analytics-engineering bigquery data-analysis data-catalog data-engineering data-lineage data-observability data-pipeline data-pipelines data-validation data-warehouse dataops dbt dbt-packages elt etl orchestration python redshift

Last synced: 05 May 2025

https://github.com/tosh2230/stairlight

A data lineage tool detects table dependencies from rendered SQL statements.

bigquery data-catalog data-discovery data-engineering data-governance data-lineage data-management data-ops dbt gcs lineage redash s3 sql

Last synced: 16 May 2025

https://github.com/nshkrdotcom/flowstone

Asset-first data orchestration for Elixir/BEAM. Dagster-inspired with OTP fault tolerance, LiveView dashboard, lineage tracking, checkpoint gates, and distributed execution via Oban.

asset-management beam chaos-engineering dag data-lineage data-orchestration data-pipeline ecto elixir fault-tolerance human-in-the-loop multi-tenant nshkr-ai-agents oban otp phoenix-liveview scheduling tdd telemetry workflow-engine

Last synced: 13 Jan 2026

https://github.com/tuva-health/provider

A dbt project that transforms messy public provider datasets into usable data for the Tuva Project.

analytics-engineering data-analytics data-governance data-lineage data-pipelines data-warehouse dbt healthcare healthcare-analysis healthcare-data open-source providers snowflake sql

Last synced: 18 Mar 2026

https://github.com/badoo/exasol-data-lineage

Exasol data lineage scripts

data-lineage exasol exasol-db lua

Last synced: 30 Apr 2025

https://github.com/tosh2230/stairlight-app

A web application rendering table dependency graph with tosh2230/stairlight, using Graphviz, Streamlit and Google Cloud Run.

cloudrun data-lineage gcp graphviz streamlit

Last synced: 17 Aug 2025

https://github.com/tracesql/tracesql-py

Python client for TraceSQL lineage analyzer

data-lineage database lineage sql sql-lineage

Last synced: 30 Jul 2025

https://github.com/arbaznazir/datalineagepy

86% faster data lineage tracking for pandas DataFrames with zero infrastructure. Real-time monitoring, ML anomaly detection, and enterprise compliance features.

anomaly-detection data-eng data-governance data-lineage data-quality data-science dataframes enterprise etl lineage-tracing machine-learning pandas python

Last synced: 28 Apr 2026

https://github.com/jbris/openmetadata-test

Testing a Docker deployment of OpenMetadata for S3 data ingestion

data-lineage data-observability minio minio-docker openmetadata openmetadata-docker s3

Last synced: 18 Feb 2026

https://github.com/tata-fs4/data_governance

Data governance framework with cataloging, access control, lineage tracking and data quality pipelines for medallion lakehouses

best-practices compliance data-catalog data-governance data-lineage data-quality dbt lgpd master-data-management medallion-architecture privacy python security

Last synced: 10 Jun 2026

https://github.com/lpraat/inbq

A library for parsing BigQuery queries and extracting schema-aware, column-level lineage.

bigquery data-lineage parser sql

Last synced: 26 Apr 2026

https://github.com/michaelosthege/gittrail

Context manager for enforcing links between data pipeline outputs and git history.

data-lineage data-science

Last synced: 05 Nov 2025

https://github.com/ccyrene/trace-weaver

Static column-level data-lineage compiler for annotated Airflow DAGs — declared vs inferred provenance; exports to OpenMetadata / OpenLineage / Graphviz.

airflow column-level-lineage data-engineering data-lineage metadata openlineage openmetadata rust

Last synced: 16 Jul 2026

https://github.com/jbris/marquez-test

Testing a Docker deployment of Marquez and OpenLineage

data-lineage data-observability marquez marquez-docker observability openlineage openlineage-docker

Last synced: 06 Feb 2026

https://github.com/hytfjwr/dbtl

A terminal UI for exploring dbt model lineage as ASCII art

analytics-engineering cli data-lineage dbt ratatui rust terminal tui

Last synced: 11 Jun 2026

https://github.com/prakulhiremath/flashback

⏪ Git for DataFrames. Time-travel debugging, exact temporal lineage, and feature evolution tracking for Pandas and Polars.

data-lineage data-versioning mlops polars time-travel

Last synced: 14 Jun 2026

https://github.com/hugozanini/open-metadata-cursor-extension

AI-powered data discovery extension for Cursor & VS Code with natural language search and interactive lineage visualization

ai cursor cursor-extension data-discovery data-lineage gemini open-metadata vscode-extension

Last synced: 18 May 2026

https://github.com/srijan-singh/neo4j-lineage

Holistic approach for understanding Neo4j and Data Lineage

data-lineage java neo4j

Last synced: 19 May 2026

https://github.com/subhamay-bhattacharyya/glue-lineage-scanner

Scan AWS Glue PySpark jobs in GitHub repositories to generate data lineage using AST analysis and LLMs.

ast aws-glue data-governance data-lineage generative-ai llm metadata openlineage pyspark python

Last synced: 02 May 2026

https://github.com/cmangun/agentic-artifacts

Artifact manifests and provenance rules for integrity-preserved agent outputs

agentic-systems data-integrity data-lineage manifest provenance slsa verifiable-ai

Last synced: 03 May 2026

https://github.com/cmdrvl/edgar-fabric-ingest

A TypeScript CLI and Codex-friendly reference implementation for ingesting EDGAR disclosures into an append-only CQRS context layer. Focused on auditability, replayability, and strict schema discipline.

cmdrvl command-query-separation context-graph cqrs data-lineage edgar event-sourcing financial-data neo4j open-finance sec-filin typescript

Last synced: 28 Jan 2026

https://github.com/superthinking/data_lineage_visualization-application

Helps you to visualize data lineage. Highly customizable.

data-lineage data-lineage-visualization reactjs

Last synced: 14 May 2026