https://github.com/miozilla/dataengineering

DataEngineering
https://github.com/miozilla/dataengineering

Last synced: 5 months ago
JSON representation

DataEngineering

• Host: GitHub
• URL: https://github.com/miozilla/dataengineering
• Owner: miozilla
• Created: 2025-06-02T13:42:00.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2025-10-29T11:28:07.000Z (8 months ago)
• Last Synced: 2025-10-29T13:26:47.086Z (8 months ago)
• Size: 4.88 KB
• Stars: 0
• Watchers: 0
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# DataEngineering

DataEngineering

## Data Engineering Role Repositories

| | Projects | Descriptions | Topics | 

| - | :-: | :-: | :-: |

| - | ![airflowazapp ♻️](https://github.com/miozilla/airflowazapp) | Airflow | Azure Web App, DAG |

| - | ![azsqldb 🏢](https://github.com/miozilla/azsqldb) | Azure SQL Database | Azure SQL DB |

| - | ![bigquery 🔎](https://github.com/miozilla/bigquery) | BigQuery | GCP |

| - | ![bigtable 🌀](https://github.com/miozilla/bigtable) | Bigtable Database | GCP, NOSQL, Backup, cbt CLI |

| - | ![cosmosdbcassandra 🪐](https://github.com/miozilla/cosmosdbcassandra) | Automotive | Cosmosdb, Cassandra, cql |

| - | ![datafactory 🏭](https://github.com/miozilla/datafactory) | Data Factory | Blob, datafactory, bicep |

| - | ![dataflowbeam 🗼](https://github.com/miozilla/dataflowbeam) | Dataflow & Apache Beam | IAM |

| - | ![dataprochs 🐘🐝](https://github.com/miozilla/dataprochs) | Dataproc Cluster | Apache Hadoop, MapReduce, Spark, YARN, HDFS | 

| - | ![dbt 🦆](https://github.com/miozilla/dbt)  | Data Build Tool | DBT, duckdb |

| - | ![deltalakes2 🤽‍♀️](https://github.com/miozilla/deltalakes2) | Deltalake | Spark, Synapse |

| - | ![fabric_ds 👚](https://github.com/miozilla/fabric_ds) | Fabric | Microsoft Fabric |

| - | ![finosql-dynamodb 🧴](https://github.com/miozilla/finosql-dynamodb) | Streaming Entertainment Scalable & Fast Database | DynamoDB, NoSQL |

| - | ![fleetm365 🛳️🏦](https://github.com/miozilla/fleetm365) | Finance & Operations (Fleet Management) | Dynamic 365, Office Integration, Functional Consultant | 

| - | ![flightware 🛫](https://github.com/miozilla/flightware) | Aviation / Aerospace | Scrapy, mongodb, fastapi |

| - | ![gcdatacatalog 🚕📱](https://github.com/miozilla/gcdatacatalog) | Google Cloud Data Catalog | Metadata Management, Tag |

| - | ![hl7fhir 🩺🧑‍⚕️](https://github.com/miozilla/hl7fhir) | Cloud Healthcare API | Streaming HL7 to FHIR Data, Dataflow, Datasets, Stores, DICOM |

| - | ![kafkaz00 🦘🦓](https://github.com/miozilla/kafkaz00) | Apache Kafka | Zookeeper, gcp |

| - | ![mariadbanalyst 👩‍🔧🦭🛢️](https://github.com/miozilla/mariadbanalyst) | MariaDB | SQL, JOIN, Relational Database | 

| - | ![medi3ds 🩻](https://github.com/miozilla/medi3ds) | Healthcare / Medical | Matplotlib, numpy, cv2, postgres, grafana |

| - | ![miomnibqaws 🔎😶‍🌫️🪣](https://github.com/miozilla/miomnibqaws) | Google Cloud & AWS Integration | BigQuery Omni, S3, External Table |

| - | ![miords 🌌](https://github.com/miozilla/miords) | Aurora and RDS | Multi-AZ, Read Replica Database, MariaDB |

| - | ![pandas 🐼🐼](https://github.com/miozilla/pandas) | Python Library | Data Analysis, Dataframe, pandas, sqlite3 |

| - | ![rcode 🐧®️📊](https://github.com/miozilla/rcode) | Analysis Using R | R Programming Language, Dplyr, Palmerpenguins, Data Cleaning | 

| - | ![rdscloudsql 🚚🚛](https://github.com/miozilla/rdscloudsql) | Amazon RDS to Google Cloud SQL Database Migration | MySQL |

| - | ![snowden ⛄🎮](https://github.com/miozilla/snowden) |  VR Game | Snowflake, Data Engineering, ELT | 

| - | ![snowstock ❄️](https://github.com/miozilla/snowstock) | Stock Market / Finance | Snowflake, yfinance |

| - | ![synapse :atom:](https://github.com/miozilla/synapse) | Public Transportation | Synapse-analytics, power_bi |

| - | ![weatherny 🌦️📈](https://github.com/miozilla/weatherny) | Weather Data | BigQuery, Correlation |