{"id":15060702,"url":"https://github.com/googlecloudplatform/cortex-data-foundation","last_synced_at":"2025-05-16T14:07:58.816Z","repository":{"id":37577865,"uuid":"466278534","full_name":"GoogleCloudPlatform/cortex-data-foundation","owner":"GoogleCloudPlatform","description":"Data Foundation - Google Cloud Cortex Framework","archived":false,"fork":false,"pushed_at":"2025-05-14T14:31:28.000Z","size":37102,"stargazers_count":187,"open_issues_count":0,"forks_count":103,"subscribers_count":45,"default_branch":"main","last_synced_at":"2025-05-14T15:44:02.154Z","etag":null,"topics":["airflow","bigquery","cloud","google","googlecloud","salesforce","sap"],"latest_commit_sha":null,"homepage":"https://cloud.google.com/solutions/cortex","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/GoogleCloudPlatform.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"docs/contributing.md","funding":null,"license":"LICENSE","code_of_conduct":"docs/code-of-conduct.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":"support.sh","governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2022-03-04T21:43:55.000Z","updated_at":"2025-05-08T15:51:36.000Z","dependencies_parsed_at":"2024-04-11T22:46:29.439Z","dependency_job_id":"497680ca-38bf-4569-af1b-e51d0a54962e","html_url":"https://github.com/GoogleCloudPlatform/cortex-data-foundation","commit_stats":null,"previous_names":[],"tags_count":22,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GoogleCloudPlatform%2Fcortex-data-foundation","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GoogleCloudPlatform%2Fcortex-data-foundation/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GoogleCloudPlatform%2Fcortex-data-foundation/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GoogleCloudPlatform%2Fcortex-data-foundation/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/GoogleCloudPlatform","download_url":"https://codeload.github.com/GoogleCloudPlatform/cortex-data-foundation/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254544146,"owners_count":22088807,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["airflow","bigquery","cloud","google","googlecloud","salesforce","sap"],"created_at":"2024-09-24T23:03:20.344Z","updated_at":"2025-05-16T14:07:53.808Z","avatar_url":"https://github.com/GoogleCloudPlatform.png","language":"Python","readme":"# Cortex Data Foundation\n\nThe Cortex Data Foundation is the core architectural component of\n[Google Cloud Cortex Framework](https://cloud.google.com/solutions/cortex).\nCortex Framework provides reference architectures, deployable solutions, and\npackaged implementation services to kickstart your Data and AI Cloud journey.\nCortex Framework incorporates your source data into tools and services that help ingest,\ntransform, and load it to get insights faster from pre-defined data models that can be automatically\ndeployed for use with [Google Cloud BigQuery](https://cloud.google.com/bigquery)\n\nThis repository contains the Entity Relationship (ERD) diagrams, scripts and files\nto deploy the Cortex Framework. For more information and instructions, see our\nofficial [Cortex Framework documentation site](https://cloud.google.com/cortex/docs).\n\n# Data sources and workloads\n\nCortex Framework focuses on solving specific problems and offers pre built solutions\nfor business areas like Marketing, Sales, Supply Chain, Manufacturing, Finance, and Sustainability.\nCortex Framework is flexible and it can include data from sources beyond what is prebuilt.\nThe following are the data sources available. For more information about each one, click any\nof them.\n\n**Marketing**:\n\n*   [Salesforce Marketing Cloud](https://cloud.google.com/cortex/docs/marketing-salesforce)\n*   [Google Ads](https://cloud.google.com/cortex/docs/marketing-googleads)\n*   [Campaign Manager 360 (CM360)](https://cloud.google.com/cortex/docs/marketing-cm360)\n*   [TikTok](https://cloud.google.com/cortex/docs/marketing-tiktok)\n*   [Meta](https://cloud.google.com/cortex/docs/marketing-meta)\n*   [LiveRamp](https://cloud.google.com/cortex/docs/marketing-liveramp)\n*   [YouTube (with DV360)](https://cloud.google.com/cortex/docs/marketing-dv360)\n*   [Google Analytics 4](https://cloud.google.com/cortex/docs/marketing-google-analytics)\n*   [Cross Media \u0026 Product Connected Insights](https://cloud.google.com/cortex/docs/marketing-cross-media)\n\n**Operational**:\n\n*   [SAP (ECC and S/4)](https://cloud.google.com/cortex/docs/operational-sap)\n*   [Salesforce Sales Cloud](https://cloud.google.com/cortex/docs/operational-salesforce)\n*   [Oracle EBS](https://cloud.google.com/cortex/docs/operational-oracle-ebs)\n\n**Sustainability**:\n\n*   [Dun \u0026 Bradstreet with SAP](https://cloud.google.com/cortex/docs/dun-and-bradstreet)\n\n**Note**: If you want to know more about which entities are covered in each data source, see the\nEntity-Relationship Diagrams (ERD) in the [docs](https://github.com/GoogleCloudPlatform/cortex-data-foundation/tree/main/docs) folder.\n\n# Deployment\n\nFor Cortex Framework deployment instructions, see the following:\n\n*   **Quickstart Demo**: a [quickstart demo](https://cloud.google.com/cortex/docs/quickstart-demo) to\ntest the Cortex Framework set up process with sample data within just a few clicks. *This demo deployment\nis not suitable for production environments*.\n*   **Deployment steps**: after reading the [prerequisites](https://cloud.google.com/cortex/docs/deployment-prerequisites) for Cortex Data Foundation deployment, follow the steps for deployment in production environments:\n    1. [Establish workloads](https://cloud.google.com/cortex/docs/deployment-step-one)\n    2. [Clone repository](https://cloud.google.com/cortex/docs/deployment-step-two)\n    3. [Determine integration mechanism](https://cloud.google.com/cortex/docs/deployment-step-three)\n    4. [Set up components](https://cloud.google.com/cortex/docs/deployment-step-four)\n    5. [Configure deployment](https://cloud.google.com/cortex/docs/deployment-step-five)\n    6. [Execute deployment](https://cloud.google.com/cortex/docs/deployment-step-six)\n\n## Optional steps\n\nYou can customize your Cortex Framework deployment with the following optional steps:\n\n*   [Use different projects to segregate access](https://cloud.google.com//cortex/docs/optional-step-segregate-access)\n*   [Use Cloud Build features](https://cloud.google.com//cortex/docs/optional-step-cloud-build-features)\n*   [Configure external datasets for K9](https://cloud.google.com//cortex/docs/optional-step-external-datasets)\n*   [Enable Turbo Mode](https://cloud.google.com/cortex/docs/optional-step-turbo-mode)\n*   [Telemetry](https://cloud.google.com/cortex/docs/optional-step-telemetry)\n*   [Configure Common Dimensions](https://cloud.google.com/cortex/docs/optional-step-common-dimensions)\n\n## Looker Blocks and Dashboards\n\nAfter Cortex Framework deployment, you can take advantage of prebuilt Looker Blocks and Dashboards for some of the Cortex Framework data sources.\nFor more information, see [Looker Blocks and Dashboards overview](https://cloud.google.com/cortex/docs/looker-block-overview).\n\nThe following are the Looker Blocks and Dashboards available in Cortex Framework:\n\n* Looker Blocks\n    *   **Operational**\n        *   [Looker Block for SAP](https://cloud.google.com/cortex/docs/looker-block-sap)\n        *   [Looker Block for Salesforce](https://cloud.google.com/cortex/docs/looker-block-salesforce)\n        *   [Looker Block for Oracle EBS](https://cloud.google.com/cortex/docs/looker-block-oracle-ebs)\n    *   **Marketing**\n        *   [Looker Block for Salesforce Marketing Cloud](https://cloud.google.com/cortex/docs/looker-block-salesforce-marketing)\n        *   [Looker Block for Meta](https://cloud.google.com/cortex/docs/looker-block-meta)\n        *   [Looker Block for YouTube (with DV360)](https://cloud.google.com/cortex/docs/looker-block-youtube)\n        *   [Looker Block for Cross Media \u0026 Product Connected Insights](https://cloud.google.com/cortex/docs/looker-block-cross-media)\n* Looker Studio Dashboards\n    *   **Sustainability**\n        *   [Looker Studio Dashboard for Dun \u0026 Bradstreet](https://cloud.google.com/cortex/docs/looker-dashboard-dun-and-bradstreet)\n\nNote: If you are looking for the README files before Release 6.0, see the\n[deprecated docs folder](https://github.com/GoogleCloudPlatform/cortex-data-foundation/tree/main/docs/deprecated).\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgooglecloudplatform%2Fcortex-data-foundation","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgooglecloudplatform%2Fcortex-data-foundation","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgooglecloudplatform%2Fcortex-data-foundation/lists"}