{"id":30586199,"url":"https://github.com/miozilla/dataengineering","last_synced_at":"2026-02-13T17:04:08.343Z","repository":{"id":301168688,"uuid":"994791715","full_name":"miozilla/DataEngineering","owner":"miozilla","description":"DataEngineering","archived":false,"fork":false,"pushed_at":"2025-10-29T11:28:07.000Z","size":5,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-10-29T13:26:47.086Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/miozilla.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-06-02T13:42:00.000Z","updated_at":"2025-10-29T11:28:16.000Z","dependencies_parsed_at":"2025-07-24T10:20:41.970Z","dependency_job_id":"e7d05ca1-b23c-4b8e-b696-47035e8aff94","html_url":"https://github.com/miozilla/DataEngineering","commit_stats":null,"previous_names":["miozilla/dataengineering"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/miozilla/DataEngineering","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/miozilla%2FDataEngineering","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/miozilla%2FDataEngineering/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/miozilla%2FDataEngineering/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/miozilla%2FDataEngineering/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/miozilla","download_url":"https://codeload.github.com/miozilla/DataEngineering/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/miozilla%2FDataEngineering/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29412670,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-13T06:24:03.484Z","status":"ssl_error","status_checked_at":"2026-02-13T06:23:12.830Z","response_time":78,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-08-29T11:44:14.895Z","updated_at":"2026-02-13T17:04:08.337Z","avatar_url":"https://github.com/miozilla.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"# DataEngineering\nDataEngineering\n\n\n## Data Engineering Role Repositories\n\n\n| | Projects | Descriptions | Topics | \n| - | :-: | :-: | :-: |\n| - | ![airflowazapp ♻️](https://github.com/miozilla/airflowazapp) | Airflow | Azure Web App, DAG |\n| - | ![azsqldb 🏢](https://github.com/miozilla/azsqldb) | Azure SQL Database | Azure SQL DB |\n| - | ![bigquery 🔎](https://github.com/miozilla/bigquery) | BigQuery | GCP |\n| - | ![bigtable 🌀](https://github.com/miozilla/bigtable) | Bigtable Database | GCP, NOSQL, Backup, cbt CLI |\n| - | ![cosmosdbcassandra 🪐](https://github.com/miozilla/cosmosdbcassandra) | Automotive | Cosmosdb, Cassandra, cql |\n| - | ![datafactory 🏭](https://github.com/miozilla/datafactory) | Data Factory | Blob, datafactory, bicep |\n| - | ![dataflowbeam 🗼](https://github.com/miozilla/dataflowbeam) | Dataflow \u0026 Apache Beam | IAM |\n| - | ![dataprochs 🐘🐝](https://github.com/miozilla/dataprochs) | Dataproc Cluster | Apache Hadoop, MapReduce, Spark, YARN, HDFS | \n| - | ![dbt 🦆](https://github.com/miozilla/dbt)  | Data Build Tool | DBT, duckdb |\n| - | ![deltalakes2 🤽‍♀️](https://github.com/miozilla/deltalakes2) | Deltalake | Spark, Synapse |\n| - | ![fabric_ds 👚](https://github.com/miozilla/fabric_ds) | Fabric | Microsoft Fabric |\n| - | ![finosql-dynamodb 🧴](https://github.com/miozilla/finosql-dynamodb) | Streaming Entertainment Scalable \u0026 Fast Database | DynamoDB, NoSQL |\n| - | ![fleetm365 🛳️🏦](https://github.com/miozilla/fleetm365) | Finance \u0026 Operations (Fleet Management) | Dynamic 365, Office Integration, Functional Consultant | \n| - | ![flightware 🛫](https://github.com/miozilla/flightware) | Aviation / Aerospace | Scrapy, mongodb, fastapi |\n| - | ![gcdatacatalog 🚕📱](https://github.com/miozilla/gcdatacatalog) | Google Cloud Data Catalog | Metadata Management, Tag |\n| - | ![hl7fhir 🩺🧑‍⚕️](https://github.com/miozilla/hl7fhir) | Cloud Healthcare API | Streaming HL7 to FHIR Data, Dataflow, Datasets, Stores, DICOM |\n| - | ![kafkaz00 🦘🦓](https://github.com/miozilla/kafkaz00) | Apache Kafka | Zookeeper, gcp |\n| - | ![mariadbanalyst 👩‍🔧🦭🛢️](https://github.com/miozilla/mariadbanalyst) | MariaDB | SQL, JOIN, Relational Database | \n| - | ![medi3ds 🩻](https://github.com/miozilla/medi3ds) | Healthcare / Medical | Matplotlib, numpy, cv2, postgres, grafana |\n| - | ![miomnibqaws 🔎😶‍🌫️🪣](https://github.com/miozilla/miomnibqaws) | Google Cloud \u0026 AWS Integration | BigQuery Omni, S3, External Table |\n| - | ![miords 🌌](https://github.com/miozilla/miords) | Aurora and RDS | Multi-AZ, Read Replica Database, MariaDB |\n| - | ![pandas 🐼🐼](https://github.com/miozilla/pandas) | Python Library | Data Analysis, Dataframe, pandas, sqlite3 |\n| - | ![rcode 🐧®️📊](https://github.com/miozilla/rcode) | Analysis Using R | R Programming Language, Dplyr, Palmerpenguins, Data Cleaning | \n| - | ![rdscloudsql 🚚🚛](https://github.com/miozilla/rdscloudsql) | Amazon RDS to Google Cloud SQL Database Migration | MySQL |\n| - | ![snowden ⛄🎮](https://github.com/miozilla/snowden) |  VR Game | Snowflake, Data Engineering, ELT | \n| - | ![snowstock ❄️](https://github.com/miozilla/snowstock) | Stock Market / Finance | Snowflake, yfinance |\n| - | ![synapse :atom:](https://github.com/miozilla/synapse) | Public Transportation | Synapse-analytics, power_bi |\n| - | ![weatherny 🌦️📈](https://github.com/miozilla/weatherny) | Weather Data | BigQuery, Correlation |\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmiozilla%2Fdataengineering","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmiozilla%2Fdataengineering","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmiozilla%2Fdataengineering/lists"}