Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists tagged with redshift

A curated list of projects in awesome lists tagged with redshift .

https://github.com/dbeaver/dbeaver

Free universal database tool and SQL client

database db2 dbeaver erd gui java mysql nosql oracle postgresql redshift sql sqlite sqlserver tycho

Last synced: 16 Dec 2024

https://github.com/getredash/redash

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

analytics athena bi bigquery business-intelligence dashboard databricks hacktoberfest javascript mysql postgresql python redash redshift spark spark-sql visualization

Last synced: 16 Dec 2024

https://github.com/airbytehq/airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

bigquery change-data-capture data data-analysis data-collection data-engineering data-integration data-pipeline elt etl java mssql mysql pipeline postgresql python redshift s3 self-hosted snowflake

Last synced: 16 Dec 2024

https://github.com/apache/doris

Apache Doris is an easy-to-use, high performance and unified analytics database.

bigquery database dbt delta-lake elt etl hadoop hive hudi iceberg lakehouse olap query-engine real-time redshift snowflake spark sql

Last synced: 16 Dec 2024

https://github.com/apache/incubator-doris

Apache Doris is an easy-to-use, high performance and unified analytics database.

bigquery database dbt delta-lake elt etl hadoop hive hudi iceberg lakehouse olap query-engine real-time redshift snowflake spark sql

Last synced: 14 Dec 2024

https://github.com/jonls/redshift

Redshift adjusts the color temperature of your screen according to your surroundings. This may help your eyes hurt less if you are working in front of the screen at night.

color-temperature eye-strain gamma-ramps night night-mode redshift

Last synced: 20 Dec 2024

https://github.com/plotly/falcon

Free, open-source SQL client for Windows and Mac 🦅

electron falcon mysql-client plotly postgresql redshift sql visualization

Last synced: 10 Oct 2024

https://github.com/jitsucom/jitsu

Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days

bigquery clickhouse data-collection data-connectors data-integration golang postgres redshift snowflake

Last synced: 16 Dec 2024

https://github.com/aws/aws-sdk-pandas

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

amazon-athena amazon-sagemaker-notebook apache-arrow apache-parquet athena aws aws-glue aws-lambda data-engineering data-science emr etl glue-catalog lambda modin mysql pandas python ray redshift

Last synced: 16 Dec 2024

https://github.com/dresende/node-orm2

Object Relational Mapping

database mongodb mysql orm postgresql redshift sqlite

Last synced: 18 Dec 2024

https://github.com/elementary-data/elementary

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

analytics-engineer bigquery data-analysis data-governance data-lineage data-observability data-pipeline data-pipelines data-reliability data-warehouse dataops dbt dbt-artifacts dbt-packages lineage redshift snowflake

Last synced: 17 Dec 2024

https://github.com/artie-labs/transfer

Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift, Databricks) in real-time.

apache-kafka bigquery cdc change-data-capture data-integration data-pipelines database debezium elt golang kafka redshift snowflake

Last synced: 20 Dec 2024

https://github.com/rdagumampan/yuniql

Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS MAY 2022! v1.3.15 released!

amazon-rds azure-sql-database data-engineering database-migrations datawarehouse dotnet-core dotnet-tool mariadb mysql oracle postgresql redshift snowflake sql sqlserver yuniql

Last synced: 21 Dec 2024

https://github.com/datacoves/dbt-coves

CLI tool for dbt users to simplify creation of staging models (yml and sql) files

analytics bigquery datacoves dbt elt etl jinja python redshift snowflake sql

Last synced: 20 Dec 2024

https://github.com/data-dot-all/dataall

A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.

aws aws-glue aws-lake-formation aws-s3 data data-science etl-framework lakeformation lakehouse redshift

Last synced: 04 Dec 2024

https://github.com/cuebook/CueObserve

Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases

anomaly anomaly-detection bigquery datawarehouse prophet-facebook redshift root-cause-analysis snowflake sql timeseries-analysis timeseries-forecasting

Last synced: 14 Nov 2024

https://github.com/cuebook/cueobserve

Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases

anomaly anomaly-detection bigquery datawarehouse prophet-facebook redshift root-cause-analysis snowflake sql timeseries-analysis timeseries-forecasting

Last synced: 19 Dec 2024

https://github.com/cartodb/analytics-toolbox-core

A set of UDFs and Procedures to extend BigQuery, Snowflake, Redshift, Postgres and Databricks with Spatial Analytics capabilities

analytics-toolbox bigquery carto databricks geospatial gis postgres redshift snowflake sql

Last synced: 17 Dec 2024

https://github.com/xnuinside/simple-ddl-parser

Simple DDL Parser to parse SQL (HQL, TSQL, AWS Redshift, BigQuery, Snowflake and other dialects) ddl files to json/python dict with full information about columns: types, defaults, primary keys, etc. & table properties, types, domains, etc.

bigquery columns ddl ddl-parser ddls hive hql mssql mysql oracle-database oracle-db parser postgresql redshift schemas snowflake sql sql-parser tsql types

Last synced: 20 Dec 2024

https://github.com/schireson/pytest-mock-resources

Pytest Fixtures that let you actually test against external resource (Postgres, Mongo, Redshift...) dependent code.

docker hacktoberfest knownip library mongo mongodb postgres pytest pytest-fixtures python redshift tidepod

Last synced: 20 Dec 2024

https://github.com/omnata-labs/dbt-ml-preprocessing

A SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.

bigquery dbt redshift scikit-learn snowflake

Last synced: 19 Dec 2024

https://github.com/lynnlangit/hello-aws-data-services

AWS Data/MLServices sample code & notes for my LinkedIn Learning courses

athena aws aws-cli aws-sdk dynamodb emr kinesis rds redshift sagemaker

Last synced: 28 Oct 2024

https://github.com/lynnlangit/Hello-AWS-Data-Services

AWS Data/MLServices sample code & notes for my LinkedIn Learning courses

athena aws aws-cli aws-sdk dynamodb emr kinesis rds redshift sagemaker

Last synced: 03 Sep 2024

https://github.com/garystafford/tickit-data-lake-demo

Resources for video demonstrations and blog posts related to DataOps on AWS

airflow aws data-lake dataops devops redshift

Last synced: 18 Dec 2024

https://github.com/d4l3k/go-sct

A color temperature setting library and CLI that operates in a similar way to f.lux and Redshift. Supports Wayland, X and Windows

color-temperature flux redshift sct wayland

Last synced: 04 Dec 2024

https://github.com/iam-mhaseeb/skytrax-data-warehouse

A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.

airflow data-analysis data-analytics data-cleaning data-engineering data-orchestration data-processing data-visualization data-warehouse data-warehousing database docker metabase python python3 redshift s3 s3-bucket sql

Last synced: 14 Dec 2024

https://github.com/theseus-rs/rsql

Command line interface for DuckDB, LibSQL, MariaDB, MySQL, PostgreSQL, Redshift, Snowflake, SQLite3 and SQL Server

command-line data database duckdb mariadb mysql postgres postgresql redshift rust snowflake sql sqlite sqlite3 sqlserver

Last synced: 15 Dec 2024

https://github.com/scalefreecom/datavault4dbt

Scalefree's dbt package for a Data Vault 2.0 implementation congruent to the original Data Vault 2.0 definition by Dan Linstedt including the Staging Area, DV2.0 main entities, PITs and Snapshot Tables.

azure-synapse bigquery datavault dbt dbt-packages exasol google-bigquery hubs links pits postgresql redshift satellites scalefree snapshots snowflake sourcemarts stagingarea

Last synced: 18 Dec 2024

https://github.com/ScalefreeCOM/datavault4dbt

Scalefree's dbt package for a Data Vault 2.0 implementation congruent to the original Data Vault 2.0 definition by Dan Linstedt including the Staging Area, DV2.0 main entities, PITs and Snapshot Tables.

azure-synapse bigquery datavault dbt dbt-packages exasol google-bigquery hubs links pits postgresql redshift satellites scalefree snapshots snowflake sourcemarts stagingarea

Last synced: 13 Nov 2024

https://github.com/toucantoco/weaverbird

A visual data pipeline builder with various backends

data-transformation mongodb mysql pandas postgresql redshift snowflake sql vuejs

Last synced: 18 Dec 2024

https://github.com/feathersjs-ecosystem/feathers-objection

Feathers database adapter for Objection.js, an ORM based on KnexJS SQL query builder for Postgres, Redshift, MSSQL, MySQL, MariaDB, SQLite3, and Oracle. Forked from feathers-knex.

feathers-knex feathers-service-adapter feathersjs knex mysql objection-orm objectionjs orm postgres postgresql redshift

Last synced: 17 Nov 2024

https://github.com/mcchrish/feathers-objection

Feathers database adapter for Objection.js, an ORM based on KnexJS SQL query builder for Postgres, Redshift, MSSQL, MySQL, MariaDB, SQLite3, and Oracle. Forked from feathers-knex.

feathers-knex feathers-service-adapter feathersjs knex mysql objection-orm objectionjs orm postgres postgresql redshift

Last synced: 01 Oct 2024

https://github.com/datakitchen/data-observability-installer

Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team is the first to know and the first to solve with visibility across and down your data estate. Save time with simple, fast data quality test generation and execution. Trust your data, tools, and systems end to end.

data data-engineering data-observability data-profiling data-quality data-reliability data-science datachecker datacleaner datacleaning dataops dataquality datatesting datavalidation mssql pipeline-tests postgresql redshift self-hosted snowflake

Last synced: 21 Dec 2024

https://github.com/shinichi-takii/ddlparse

DDL parase and Convert to BigQuery JSON schema and DDL statements

bigquery ddl-parse ddl-parser maria mysql oracle postgresql python redshift sql

Last synced: 16 Dec 2024

https://github.com/DataKitchen/data-observability-installer

Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team is the first to know and the first to solve with visibility across and down your data estate. Save time with simple, fast data quality test generation and execution. Trust your data, tools, and systems end to end.

data data-engineering data-observability data-profiling data-quality data-reliability data-science datachecker datacleaner datacleaning dataops dataquality datatesting datavalidation mssql pipeline-tests postgresql redshift self-hosted snowflake

Last synced: 13 Nov 2024

https://github.com/terraform-aws-modules/terraform-aws-redshift

Terraform module to create AWS Redshift resources 🇺🇦

aws redshift redshift-cluster terraform-module

Last synced: 16 Dec 2024

https://github.com/snowplow/sql-runner

Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake

bigquery postgresql redshift snowflake snowplow sql-runner

Last synced: 09 Nov 2024

https://github.com/dmanjunath/node-redshift

A simple collection of tools to help you get started with Amazon Redshift from node.js

connection-pool node-redshift orm redshift

Last synced: 17 Dec 2024

https://github.com/hearthsim/docker-pgredshift

Redshift docker image based on postgres

docker localstack postgres redshift

Last synced: 18 Dec 2024

https://github.com/ltguillaume/redshift-tray

A no-frills GUI for the excellent Redshift, with some optional OS hotkeys

autohotkey autohotkey-script color-temperature hotkeys redshift screen-brightness windows wrapper

Last synced: 18 Nov 2024

https://github.com/starlake-ai/starlake

Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.

bigquery data-engineering data-integration data-pipeline etl hdfs redshift snowflake spark synapse

Last synced: 14 Dec 2024

https://github.com/zsvoboda/dbd

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

bigquery csv database database-schemas elt etl excel json mysql parquet postgresql python python3 redshift snowflake sql sqlite xls xlsx

Last synced: 12 Oct 2024

https://github.com/khezen/avro

Apache AVRO for go

apache avro etl go golang redshift sql

Last synced: 19 Dec 2024

https://github.com/datakitchen/dataops-testgen

DataOps Data Quality TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data quality test generation and execution by data profiling,  new dataset hygiene review, AI generation of data quality validation tests, ongoing testing of data refreshes, & continuous anomaly monitoring

data data-engineering data-observability data-quality data-science data-testing datachecker dataops dataprofiling dataquality datavalidation mssql postgresql python redshift self-hosted snowflake

Last synced: 17 Dec 2024

https://github.com/snowplow/data-models

⚠️ MAINTENANCE-ONLY MODE: Snowplow maintained SQL data models for working with Snowplow web and mobile behavioral data.

bigquery redshift snowflake snowplow sql

Last synced: 09 Nov 2024

https://github.com/manuel-lang/data-engineering-nanodegree

Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift, Data Lake with Spark and Data Pipeline with Airflow.

airflow cassandra data-engineering postgresql redshift spark udacity udacity-data-engineer-nanodegree

Last synced: 13 Nov 2024

https://github.com/amazon-science/redset

Redset is a dataset containing three months worth of user query metadata that ran on a selected sample of instances in the Amazon Redshift fleet. We provide query metadata for 200 provisioned and serverless instances each.

dbms redshift

Last synced: 12 Nov 2024

https://github.com/snowplow/snowplow-rdb-loader

Stores Snowplow enriched events in Redshift, Snowflake and Databricks

redshift scala snowplow spark

Last synced: 16 Nov 2024

https://github.com/starlake-ai/jsqltranspiler

Rewrite BigQuery, Redshift, Snowflake and Databricks queries into DuckDB compatible SQL (with deep transformation of functions, data types and format characters) using Java.

bigquery databricks duckdb java query redshift rewrite snowflake transpiler

Last synced: 19 Nov 2024

https://github.com/Chemrat/redshift-qt

redshift-gtk rewrite with C++/Qt

linux qt5 redshift

Last synced: 11 Nov 2024

https://github.com/spantaleev/redshift-scheduler

Rule-based screen temperature changer (based on redshift)

color-temperature eye-care eye-strain gamma-ramps night night-mode redshift screen-brightness

Last synced: 22 Nov 2024

https://github.com/fujiwara/rin

Rin is a Redshift data Importer by SQS messaging.

aws go golang redshift rin sqs

Last synced: 28 Oct 2024

https://github.com/jaehyeon-kim/dbt-on-aws

dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats

athena dbt delta-lake emr glue hudi iceberg redshift

Last synced: 17 Dec 2024

https://github.com/duyet/grant-rs

Manage Redshift/Postgres privileges in GitOps style written in Rust

data-engineering data-ops gitops hacktoberfest postgres redshift rust

Last synced: 27 Nov 2024

https://github.com/top-guns/etl-gun

᠊ᡃ࡚ࠢ࠘ ⸝່ࠡࠣ᠊᠊ࠢ࠘᠊᠊ࠢ࠘᠊᠊ࠢ࠘᠊᠊ࠢ࠘᠊᠊° ̿̿ ̿̿💥 ETL toolkit which supports generators, RxJS streams, IxJS iterables, nodejs streams, error handling, business rules and many more

cockroachdb csv etl ftp javascript json magento mariadb mssql mysql nodejs oracle postgresql redshift sqlite telegram trello typescript webdav xml

Last synced: 18 Oct 2024

https://github.com/maandree/nightshift

[UNMAINTAINED] A terminal user interface for redshift

cct clut colour colour-temperature ergonomics interface redshift scripted

Last synced: 15 Oct 2024

https://github.com/abatten/fruitbat

A fast radio burst (FRB) redshift estimation package written in Python.

astronomy astrophysics dispersion dm frb measure python radio redshift

Last synced: 02 Nov 2024

https://github.com/aws-samples/aws-lambda-redshift-event-driven-app

Building Event Driven Application with AWS Lambda and Amazon Redshift Data API

aws eventbridge lambda-functions redshift

Last synced: 04 Dec 2024

https://github.com/thieman/exa-rs

libretro core for the TEC Redshift featured in EXAPUNKS by Zachtronics

emulator exapunks redshift rust

Last synced: 12 Nov 2024

https://github.com/openbridge/ob_pysh-db

pysh-db - The Data Science Toolkit (DSK)

bash data-science mysql postgres python redshift sql

Last synced: 14 Nov 2024

https://github.com/bondxue/Data-Warehouse-with-AWS

:mushroom:Udacity Data Engineering Nanodegree Project 3

aws-s3 data-warehouse redshift

Last synced: 04 Dec 2024

https://github.com/AuFeld/Data_Engineering_Projects

A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousing, containerization, and a dashboard to monitor data pipeline KPIs

airflow aws cassandra data-engineering data-lake data-warehouse docker emr etl-pipeline infrastructure-as-code infrastructure-setup postgresql python redshift s3 spark

Last synced: 04 Dec 2024

https://github.com/openbridge/ob_datastash

Stream your CSV files to an HTTP API

aws bigquery csv csv-files logstash parquet redshift

Last synced: 14 Nov 2024

https://github.com/servian/amazon-redshift-checklist

This checklist aims to be an exhaustive list of all elements you should consider when using Amazon Redshift.

amazon-redshift aws checklist redshift redshift-cluster redshift-spectrum

Last synced: 08 Dec 2024

https://github.com/fdmsantos/terraform-aws-kinesis-firehose

Dynamic Terraform module, which creates a Kinesis Firehose Stream and others resources like Cloudwatch, IAM Roles and Security Groups that integrate with Kinesis Firehose. Supports all destinations and all Kinesis Firehose Features.

aws coralogix datadog dynatrace elasticsearch honeycomb kinesis-firehose logicmonitor mongodb msk newrelic opensearch opensearch-serverless redshift s3 snowflake splunk sumologic terraform terraform-module

Last synced: 28 Nov 2024

https://github.com/xbaysal11/ubuntu-dotfiles

:wrench: Personal Config files for UNIX (.vimrc, .zshrc, polybar, i3wm, rofi). Your home directory is your castle. Don't leave your dotfiles behind.

bash compton dotfiles i3 i3-gaps i3wm nvim polybar polybar-scripts ranger redshift rofi shell shell-scripts tilix ubuntu vim vimrc xubuntu zsh

Last synced: 13 Nov 2024