{"id":23238460,"url":"https://github.com/zkan/data-engineering-on-gcp","last_synced_at":"2025-08-19T23:32:55.067Z","repository":{"id":214710840,"uuid":"684573482","full_name":"zkan/data-engineering-on-gcp","owner":"zkan","description":"Data Engineering on Google Cloud Platform (GCP)","archived":false,"fork":false,"pushed_at":"2024-01-27T07:26:37.000Z","size":5201,"stargazers_count":0,"open_issues_count":0,"forks_count":31,"subscribers_count":3,"default_branch":"main","last_synced_at":"2024-04-14T13:48:42.783Z","etag":null,"topics":["bigquery","data-engineering","data-lake","data-pipeline","data-warehouse","gcs","google-cloud-platform","machine-learning"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"cc0-1.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/zkan.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2023-08-29T12:19:01.000Z","updated_at":"2024-01-04T11:52:17.000Z","dependencies_parsed_at":"2024-01-22T17:23:44.439Z","dependency_job_id":null,"html_url":"https://github.com/zkan/data-engineering-on-gcp","commit_stats":null,"previous_names":["zkan/data-engineering-on-gcp"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zkan%2Fdata-engineering-on-gcp","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zkan%2Fdata-engineering-on-gcp/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zkan%2Fdata-engineering-on-gcp/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zkan%2Fdata-engineering-on-gcp/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/zkan","download_url":"https://codeload.github.com/zkan/data-engineering-on-gcp/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":230374249,"owners_count":18216044,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bigquery","data-engineering","data-lake","data-pipeline","data-warehouse","gcs","google-cloud-platform","machine-learning"],"created_at":"2024-12-19T04:17:54.899Z","updated_at":"2024-12-19T04:17:55.297Z","avatar_url":"https://github.com/zkan.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Data Engineering on Google Cloud Platform (GCP)\n\n### Table of Contents\n\n* [Prerequisites](#prerequisites)\n* [Course Modules](#course-modules)\n* [Datasets](#datasets)\n\n## Prerequisites\n\n1. Python\n1. SQL\n1. Git \u0026 GitHub\n1. Command-Line Interface (CLI)\n1. Docker\n1. Google Cloud Platform (GCP)\n\n## Course Modules\n\n1. [Introduction to Data Engineering](01-introduction-to-data-engineering)\n1. [Building a Data Warehouse with BigQuery](02-building-a-data-warehouse-with-bigquery)\n1. [Setting up Data Lake using Google Cloud Storage](03-setting-up-data-lake-using-google-cloud-storage)\n1. [Building Data Pipelines with Apache Airflow (Cloud Composer)](04-building-data-pipelines-with-apache-airflow-cloud-composer)\n1. [Data Visualization with Looker Studio](05-data-visualization-with-looker-studio)\n1. [Implementing Machine Learning Models in BigQuery ML](06-implementing-machine-learning-models-in-bigquery-ml)\n1. [Real-world Capstone Project](07-real-world-capstone-project)\n\n## Datasets\n\n* [Breakfast at the Frat](https://github.com/zkan/open-data/tree/main/breakfast-at-the-frat)\n* [Best Buy](https://github.com/zkan/open-data/tree/main/best-buy-apis)","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzkan%2Fdata-engineering-on-gcp","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fzkan%2Fdata-engineering-on-gcp","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzkan%2Fdata-engineering-on-gcp/lists"}