Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with data-warehouse

A curated list of projects in awesome lists tagged with data-warehouse .

https://github.com/posthog/posthog

🦔 PostHog is an all-in-one developer platform for building successful products. We offer product analytics, web analytics, session replay, error tracking, feature flags, experimentation, surveys, data warehouse, a CDP, and an AI product assistant to help debug your code, ship features faster, and keep all your usage and customer data in one stack.

ab-testing ai-analytics analytics cdp data-warehouse experiments feature-flags javascript product-analytics python react session-replay surveys typescript web-analytics

Last synced: 04 Jul 2026

https://github.com/dlt-hub/dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

data data-engineering data-lake data-loading data-warehouse elt extract load python transform

Last synced: 01 Apr 2026

https://github.com/hydradatabase/columnar

Postgres-native columnar storage extension

data-warehouse datawarehouse postgres postgresql postgresql-extension

Last synced: 14 May 2025

https://github.com/blankerl/dxy-covid-19-data

2019新型冠状病毒疫情时间序列数据仓库 | COVID-19/2019-nCoV Infection Time Series Data Warehouse

2019-ncov data-warehouse

Last synced: 15 May 2025

https://github.com/elementary-data/elementary

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

analytics-engineer bigquery data-analysis data-governance data-lineage data-observability data-pipeline data-pipelines data-reliability data-warehouse dataops dbt dbt-artifacts dbt-packages lineage redshift snowflake

Last synced: 19 May 2026

https://github.com/DataBrewery/cubes

[NOT MAINTAINED] Light-weight Python OLAP framework for multi-dimensional data analysis

cube data data-analysis data-warehouse multidimensional-analysis olap sql

Last synced: 26 Mar 2025

https://github.com/BemiHQ/BemiDB

Single-binary Postgres read replica optimized for analytics

analytics data-lakehouse data-movement data-warehouse duckdb iceberg olap parquet postgresql replication zero-etl

Last synced: 01 May 2025

https://github.com/cloudera/hue

Open source SQL Query Assistant service for Databases/Warehouses

autocomplete compose data-warehouse databases query-editor sql sql-assistant sql-editor

Last synced: 12 May 2025

https://github.com/GoogleCloudPlatform/bigquery-utils

Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.

bigquery data-warehouse google-cloud-platform sql utilities

Last synced: 06 May 2025

https://github.com/googlecloudplatform/bigquery-utils

Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.

bigquery data-warehouse google-cloud-platform sql utilities

Last synced: 14 May 2025

https://github.com/apache/cloudberry

One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.

ai big-data c cloudberry data-analysis data-warehouse database distributed-database greenplum mpp olap postgres postgresql sql

Last synced: 14 May 2025

https://github.com/pixelsdb/pixels

An efficient storage and compute engine for both on-prem and cloud-native data analytics.

cloud-database column-store data-lake data-warehouse database olap

Last synced: 03 May 2026

https://github.com/raystack/optimus

Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.

airflow analytics analytics-engineering automation bigquery business-intelligence data-modelling data-pipelines data-transformation data-warehouse dataops elt etl golang workflows

Last synced: 16 May 2025

https://github.com/canner/wren-engine

🤖 The Semantic Engine for Model Context Protocol(MCP) Clients and AI Agents 🔥

agent agentic-ai ai business-intelligence data data-analysis data-analytics data-lake data-warehouse hacktoberfest llm mcp mcp-server semantic semantic-layer sql

Last synced: 10 Mar 2026

https://github.com/domainmod/domainmod

DomainMOD is an open source application written in PHP & MySQL used to manage your domains and other internet assets in a central location. DomainMOD also includes a Data Warehouse framework that allows you to import your web server data so that you can view, export, and report on your live data.

cpanel data-warehouse domains hacktoberfest mariadb mysql php whm

Last synced: 15 May 2025

https://github.com/ubisoft/mobydq

:whale: Tool to automate data quality checks on data pipelines

big-data data-pipeline data-quality data-quality-checks data-quality-monitoring data-warehouse

Last synced: 28 Jul 2025

https://github.com/GokuMohandas/data-engineering

Construct a modern data stack and orchestration the workflows to create high quality data for analytics and ML applications.

airflow data-engineering data-warehouse dbt etl machine-learning mlops orchestration

Last synced: 11 Sep 2025

https://github.com/gokumohandas/data-engineering

Construct a modern data stack and orchestration the workflows to create high quality data for analytics and ML applications.

airflow data-engineering data-warehouse dbt etl machine-learning mlops orchestration

Last synced: 12 May 2025

https://github.com/unytics/airbyte_serverless

Airbyte made simple (no UI, no database, no cluster)

airbyte bigquery data data-analysis data-engineering data-warehouse elt etl pipeline

Last synced: 16 May 2025

https://github.com/rello/analytics

Analytics - Open source data warehouse and reporting for Nextcloud

analytics data data-warehouse datasources nextcloud visualization

Last synced: 18 Feb 2026

https://github.com/iam-mhaseeb/skytrax-data-warehouse

A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.

airflow data-analysis data-analytics data-cleaning data-engineering data-orchestration data-processing data-visualization data-warehouse data-warehousing database docker metabase python python3 redshift s3 s3-bucket sql

Last synced: 12 Aug 2025

https://github.com/Canner/wren-engine

🤖 The semantic engine for LLMs, bringing semantic context to AI agents. 🔥

business-intelligence data data-analysis data-analytics data-lake data-warehouse hacktoberfest llm semantic semantic-layer sql

Last synced: 01 Apr 2025

https://github.com/data-engineering-community/data-engineering-project-template

This is a template you can use for your next data engineering portfolio project.

data data-engineering data-warehouse etl etl-pipeline python sql

Last synced: 06 Apr 2025

https://github.com/Rello/analytics

Analytics - Open source data warehouse and reporting for Nextcloud

analytics data data-warehouse datasources nextcloud visualization

Last synced: 03 Apr 2025

https://github.com/mattiasthalen/adventure-works

Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principles on Adventure Works. Features programmatic model generation, event-enhanced Puppini bridges, and temporal resolution across DAS/DAB/DAR layers.

analytical-data-storage-system data-architecture data-engineering data-modeling data-warehouse dimensional-modeling duckdb hook-methodology iceberg lakehouse serverless sqlmesh unified-star-schema

Last synced: 11 Feb 2026

https://github.com/somasays/pgwarehouse

Easily sync your Postgres database to a Snowflake, ClickHouse, or DuckDB warehouse.

analytics clickhouse data-warehouse postgres postgresql snowflake synchronization warehouse

Last synced: 30 Aug 2025

https://github.com/sap-samples/datasphere-content

Use sample content to explorer SAP Datasphere. The downloads contain sample data as CSV files, but could also include model / metadata information. See the README files for details.

cloud data-warehouse sample sample-code sap-datasphere sap-hana

Last synced: 12 Mar 2026

https://github.com/decisionbox-io/decisionbox-platform

DecisionBox connects to your data warehouse, runs autonomous AI agents that write and execute SQL, and surfaces validated insights and actionable recommendations — without you asking a single question.

ai ai-agents analytics aws bigquery data-discovery data-warehouse gcp golang kubernetes llm nextjs open-source redshift

Last synced: 15 Apr 2026

https://github.com/MassStreetAnalytics/etl-framework

A framework for moving data into a data warehouse.

data-warehouse etl etl-components etl-framework etl-pipeline python sql sqlserver

Last synced: 20 Jul 2025

https://github.com/umer7/Data-Warehouse-Concepts-Design-and-Data-Integration

Repo for Data Warehouse Concepts, Design, and Data Integration by University of Colorado System (coursera)(Notes,Assignments, quiz and research papers)

data-integration data-warehouse datawarehouse oracle pentaho

Last synced: 20 Jul 2025

https://github.com/iiasa/ixmp

The ix modeling platform for integrated and cross-cutting scenario analysis

data-warehouse energy-system integrated-assessment modeling-tool open-source

Last synced: 21 Feb 2026

https://github.com/mattiasthalen/arcane-insight

Arcane Insight is a data analytics project designed to harness the power of SQLMesh & DuckDB to collect, transform, and analyze data from Blizzard’s Hearthstone API. Focused on card statistics and attributes, this project reveals detailed insights into card mechanics, strengths, and trends to support BI and strategic analysis.

analytics-engineering data-engineering data-vault data-warehouse duckdb elt etl hearthstone medallion-architecture sqlmesh

Last synced: 11 Feb 2026

https://github.com/cedstandards/ceds-data-warehouse

Modeled for longitudinal storage and reporting of P-20W data, the Common Education Data Standards (CEDS) Data Warehouse implements star schema data warehouse normalization techniques for improved query performance.

ceds data-warehouse data-warehouses data-warehousing education-data education-data-standards education-database sql-server

Last synced: 01 May 2026

https://github.com/mattiasthalen/obsidian-insights

Personal project for setting up an open source data warehouse.

data-warehouse dlt duckdb elt motherduck sqlmesh unified-star-schema

Last synced: 11 Feb 2026

https://github.com/montara-io/dbt-command-center

Never sift through endless dbt™ logs again. dbt Command Center is a free, open-source, local web application that provides a user-friendly interface to monitor and manage dbt runs.

analytics-engineering bigquery data-analysis data-catalog data-engineering data-lineage data-observability data-pipeline data-pipelines data-validation data-warehouse dataops dbt dbt-packages elt etl orchestration python redshift

Last synced: 05 May 2025

https://github.com/jsrl/sql-data-warehouse

Building a modern data warehouse with SQL server, including ETL processes, data modeling, and analytics.

data-warehouse etl medallion-architecture sql

Last synced: 25 Jan 2026

https://github.com/googlecloudplatform/datacatalog-connectors-hive

Sample code with integration between Data Catalog and Hive data source.

analytics apache-atlas data-warehouse datacatalog gcp hive hive-metastore metadata-management python

Last synced: 27 Oct 2025

https://github.com/dan-da/cdc_audit

change data capture via audit tables and triggers for mysql.

audit-tables cdc change-data-capture commandline data-warehouse mysql triggers

Last synced: 12 Jul 2025

https://github.com/sap-samples/analytics-cloud-datasphere-community-content

Download content packages for SAP Analytics Cloud and SAP Datasphere. Find technical samples, best practices or business scenarios. Packages contain data models, visualisations and sample data (if applicable).

analytics content data-warehouse sample sample-code sap-analytics-cloud sap-datasphere

Last synced: 13 Apr 2025

https://github.com/fulldecent/google-sheets-etl

Live import all your Google Sheets to your data warehouse

data-vault data-warehouse etl

Last synced: 26 Sep 2025

https://github.com/alexisrolland/listof

:scroll: Simple and flexible application to manage configuration data aka lists of values.

data-warehouse data-warehousing dimensions feature-store list-of-values lists mapping mapping-tools

Last synced: 08 Feb 2026

https://github.com/amey-thakur/data-warehousing-and-mining-and-data-warehousing-and-mining-lab

CSC603: Data Warehousing and Mining [DWM] & CSL603: Data Warehousing and Mining Lab [DWM Lab] | TE Semester VI | Computer Engineering

amey ameythakur computer-engineering computer-science data-mining data-warehouse data-warehouse-architecture data-warehousing engineering megasatish textbooks

Last synced: 02 Mar 2026

https://github.com/polakowo/yelp-3nf

3NF-normalize Yelp data on S3 with Spark and load it into Redshift - automate the whole thing with Apache Airflow

3nf airflow amazon-emr amazon-redshift cloud data-marts data-pipeline data-warehouse dimensional-tables etl-process normalization nosql s3-bucket spark sql yelp-dataset

Last synced: 07 May 2025

https://github.com/bondxue/Data-Warehouse-with-AWS

:mushroom:Udacity Data Engineering Nanodegree Project 3

aws-s3 data-warehouse redshift

Last synced: 29 Jul 2025

https://github.com/AuFeld/Data_Engineering_Projects

A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousing, containerization, and a dashboard to monitor data pipeline KPIs

airflow aws cassandra data-engineering data-lake data-warehouse docker emr etl-pipeline infrastructure-as-code infrastructure-setup postgresql python redshift s3 spark

Last synced: 29 Jul 2025

https://github.com/huemulsolutions/huemul-bigdatagovernance

Huemul BigDataGovernance, es una framework que trabaja sobre Spark, Hive y HDFS. Permite la implementación de una estrategia corporativa de dato único, basada en buenas prácticas de Gobierno de Datos. Permite implementar tablas con control de Primary Key y Foreing Key al insertar y actualizar datos utilizando la librería, Validación de nulos, largos de textos, máximos/mínimos de números y fechas, valores únicos y valores por default. También permite clasificar los campos en aplicabilidad de derechos ARCO para facilitar la implementación de leyes de protección de datos tipo GDPR, identificar los niveles de seguridad y si se está aplicando algún tipo de encriptación. Adicionalmente permite agregar reglas de validación más complejas sobre la misma tabla.

bigdata chile cloudera data data-engineer data-engineering data-governance data-warehouse datamart dataquality gdpr hadoop hive hortonworks huemul huemul-bigdatagovernance parquet spark spark-sql trabaja-sobre-spark

Last synced: 26 Apr 2025

https://github.com/hackersandslackers/bigquery-python-tutorial

:bar_chart: :snake: Create tables in Google BigQuery, auto-generate their schemas, and retrieve said schemas.

bigquery data-warehouse gcs google-bigquery google-cloud google-cloud-sdk google-cloud-storage python tutorial

Last synced: 28 Apr 2025

https://github.com/tuva-health/provider

A dbt project that transforms messy public provider datasets into usable data for the Tuva Project.

analytics-engineering data-analytics data-governance data-lineage data-pipelines data-warehouse dbt healthcare healthcare-analysis healthcare-data open-source providers snowflake sql

Last synced: 18 Mar 2026

https://github.com/renuka-fernando/diabetes_data_warehouse

This was done to learn Data Warehousing and Data Mining

data-warehouse etl mysql

Last synced: 01 May 2025

https://github.com/txn2/mcp-data-platform

A semantic data platform MCP server that composes multiple data tools with bidirectional cross-injection - tool responses automatically include critical context from other services.

data-analysis data-lake data-warehouse golang golang-library mcp mcp-server

Last synced: 31 May 2026

https://github.com/dermatologist/goscar-export

:fire: CSV to FHIR (For OSCAR EMR EForm Export)

data-analysis data-warehouse fhir fhir-r4 fhir-server hacktoberfest oscar-emr

Last synced: 10 Sep 2025

https://github.com/sanketrs/implementation-of-modern-data-engineering-architecture-with-fabric_analytics

Building a next-generation hybrid data pipeline architecture that combines the power of Microsoft Fabric, Azure Cloud, and Power BI. This pipeline is engineered to tackle the challenges of real-time data ingestion, multi-layered processing, and analytics, delivering business-critical insights.

azure azure-data-factory azure-fabric bi-analytics big-data-analytics big-data-projects cloud-data-warehouse cloud-dataflow data-analytics data-engineering data-engineering-pipeline data-engineering-project data-pipeline-monitoring data-science data-visualization data-warehouse etl etl-framework etl-pipeline

Last synced: 14 Apr 2026

https://github.com/huwngnosleep/complete_lakehouse_techstack

This project implements an end-to-end techstack for a data platform, for local development.

bigdata data-lakehouse data-platform data-warehouse etl hadoop kafka lambda-architecture spark

Last synced: 24 Jan 2026

https://github.com/domainmod/userguide

This repository contains the Markdown files used to generate the DomainMOD User Guide.

cpanel data-warehouse domainmod domains hacktoberfest mariadb mysql php whm

Last synced: 06 May 2025

https://github.com/riju18/dashing-datawarehouse-dbt

Design the Data Warehouse with minimalistic code.

cte data-warehouse dbt jinja postgresql python sql

Last synced: 05 May 2025

https://github.com/smars-bin-hu/ecomdwh-batchdataprocessingplatform

This project aims to build an enterprise-grade offline data warehouse solution based on e-commerce platform order data.

big-data data-warehouse hadoop spark

Last synced: 26 Apr 2025

https://github.com/pirate-emperor/bigdata-pipeline

BigData Pipeline is a local testing environment for experimenting with various storage solutions (RDB, HDFS), query engines (Trino), schedulers (Airflow), and ETL/ELT tools (DBT). It supports MySQL, Hadoop, Hive, Kudu, and more.

airflow airflow-dags airflow-docker big-data data-lake data-lakestore data-warehouse dbt dbt-core distributed-computing docker docker-compose hadoop hive hiveql kudu mysql mysql-server trino trino-cli

Last synced: 08 Feb 2026