{"id":49540326,"url":"https://github.com/kogunlowo123/terraform-gcp-bigquery","last_synced_at":"2026-05-02T15:04:59.204Z","repository":{"id":343203441,"uuid":"1175452499","full_name":"kogunlowo123/terraform-gcp-bigquery","owner":"kogunlowo123","description":"Terraform module for Google BigQuery with datasets, tables, materialized views, routines, and data transfer configs","archived":false,"fork":false,"pushed_at":"2026-03-17T12:32:40.000Z","size":25,"stargazers_count":0,"open_issues_count":1,"forks_count":1,"subscribers_count":0,"default_branch":"main","last_synced_at":"2026-03-18T02:50:32.328Z","etag":null,"topics":["analytics","bigquery","data-warehouse","gcp","google-cloud","infrastructure-as-code","production-ready","terraform","terraform-module"],"latest_commit_sha":null,"homepage":null,"language":"HCL","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/kogunlowo123.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2026-03-07T18:23:17.000Z","updated_at":"2026-03-17T12:10:52.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/kogunlowo123/terraform-gcp-bigquery","commit_stats":null,"previous_names":["kogunlowo123/terraform-gcp-bigquery"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/kogunlowo123/terraform-gcp-bigquery","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kogunlowo123%2Fterraform-gcp-bigquery","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kogunlowo123%2Fterraform-gcp-bigquery/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kogunlowo123%2Fterraform-gcp-bigquery/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kogunlowo123%2Fterraform-gcp-bigquery/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/kogunlowo123","download_url":"https://codeload.github.com/kogunlowo123/terraform-gcp-bigquery/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kogunlowo123%2Fterraform-gcp-bigquery/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32538272,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-02T12:25:33.646Z","status":"ssl_error","status_checked_at":"2026-05-02T12:24:51.733Z","response_time":132,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["analytics","bigquery","data-warehouse","gcp","google-cloud","infrastructure-as-code","production-ready","terraform","terraform-module"],"created_at":"2026-05-02T15:04:56.778Z","updated_at":"2026-05-02T15:04:59.196Z","avatar_url":"https://github.com/kogunlowo123.png","language":"HCL","funding_links":[],"categories":[],"sub_categories":[],"readme":"# terraform-gcp-bigquery\n\nA production-ready Terraform module for managing Google BigQuery datasets, tables, views, materialized views, external tables, routines, row-level security, and data transfer configurations.\n\n## Architecture\n\n```mermaid\nflowchart TD\n    A[Terraform Module] --\u003e B[BigQuery Dataset]\n    B --\u003e C[Native Tables]\n    B --\u003e D[Views]\n    B --\u003e E[Materialized Views]\n    B --\u003e F[External Tables]\n    B --\u003e G[Routines]\n    B --\u003e H[Data Transfers]\n    C --\u003e I[Time Partitioning]\n    C --\u003e J[Range Partitioning]\n    C --\u003e K[Clustering]\n    C --\u003e L[CMEK Encryption]\n    B --\u003e M[Access Control]\n    M --\u003e N[IAM Roles]\n    M --\u003e O[Authorized Views]\n    M --\u003e P[Row-Level Security]\n    F --\u003e Q[GCS Sources]\n    F --\u003e R[Google Sheets]\n    G --\u003e S[UDFs]\n    G --\u003e T[Stored Procedures]\n\n    style A fill:#4285F4,stroke:#1A73E8,color:#FFFFFF\n    style B fill:#34A853,stroke:#1E8E3E,color:#FFFFFF\n    style C fill:#EA4335,stroke:#D93025,color:#FFFFFF\n    style D fill:#EA4335,stroke:#D93025,color:#FFFFFF\n    style E fill:#EA4335,stroke:#D93025,color:#FFFFFF\n    style F fill:#EA4335,stroke:#D93025,color:#FFFFFF\n    style G fill:#FF6D00,stroke:#E65100,color:#FFFFFF\n    style H fill:#FF6D00,stroke:#E65100,color:#FFFFFF\n    style I fill:#9C27B0,stroke:#7B1FA2,color:#FFFFFF\n    style J fill:#9C27B0,stroke:#7B1FA2,color:#FFFFFF\n    style K fill:#9C27B0,stroke:#7B1FA2,color:#FFFFFF\n    style L fill:#607D8B,stroke:#455A64,color:#FFFFFF\n    style M fill:#00BCD4,stroke:#0097A7,color:#FFFFFF\n    style N fill:#81C784,stroke:#66BB6A,color:#000000\n    style O fill:#81C784,stroke:#66BB6A,color:#000000\n    style P fill:#81C784,stroke:#66BB6A,color:#000000\n    style Q fill:#FBBC04,stroke:#F9AB00,color:#000000\n    style R fill:#FBBC04,stroke:#F9AB00,color:#000000\n    style S fill:#E91E63,stroke:#C2185B,color:#FFFFFF\n    style T fill:#E91E63,stroke:#C2185B,color:#FFFFFF\n```\n\n## Features\n\n- **Dataset Management**: Full lifecycle with configurable expiration, time travel, and encryption\n- **Native Tables**: Time/range partitioning, clustering, per-table CMEK encryption\n- **Views**: Standard SQL views with legacy SQL option\n- **Materialized Views**: Auto-refreshing materialized views with configurable intervals\n- **External Tables**: CSV, JSON, Avro, Parquet, Google Sheets data sources\n- **Routines**: User-defined functions (SQL/JavaScript) and stored procedures\n- **Row-Level Security**: Fine-grained row-level access policies\n- **Data Transfer**: Scheduled queries and data transfer configurations\n- **Access Control**: Dataset-level IAM, authorized views\n\n## Usage\n\n### Basic\n\n```hcl\nmodule \"bigquery\" {\n  source = \"path/to/terraform-gcp-bigquery\"\n\n  project_id  = \"my-project\"\n  dataset_id  = \"my_dataset\"\n  location    = \"US\"\n  description = \"My analytics dataset\"\n}\n```\n\n### With Tables\n\n```hcl\nmodule \"bigquery\" {\n  source = \"path/to/terraform-gcp-bigquery\"\n\n  project_id  = \"my-project\"\n  dataset_id  = \"analytics\"\n  location    = \"US\"\n\n  tables = {\n    events = {\n      schema = file(\"schemas/events.json\")\n      time_partitioning = {\n        type  = \"DAY\"\n        field = \"event_timestamp\"\n      }\n      clustering = [\"user_id\", \"event_type\"]\n    }\n  }\n}\n```\n\n## Requirements\n\n| Name | Version |\n|------|---------|\n| terraform | \u003e= 1.3 |\n| google | \u003e= 5.0 |\n| google-beta | \u003e= 5.0 |\n\n## Inputs\n\n| Name | Description | Type | Default | Required |\n|------|-------------|------|---------|----------|\n| project_id | The GCP project ID | `string` | n/a | yes |\n| dataset_id | The dataset ID | `string` | n/a | yes |\n| location | Geographic location | `string` | `\"US\"` | no |\n| friendly_name | Display name | `string` | `\"\"` | no |\n| description | Dataset description | `string` | `\"\"` | no |\n| default_table_expiration_ms | Default table expiration | `number` | `null` | no |\n| delete_contents_on_destroy | Delete tables on destroy | `bool` | `false` | no |\n| max_time_travel_hours | Time travel window (48-168) | `number` | `168` | no |\n| labels | Labels map | `map(string)` | `{}` | no |\n| default_encryption_configuration | KMS key for default encryption | `string` | `null` | no |\n| tables | Native table definitions | `map(object)` | `{}` | no |\n| views | View definitions | `map(object)` | `{}` | no |\n| materialized_views | Materialized view definitions | `map(object)` | `{}` | no |\n| external_tables | External table definitions | `map(object)` | `{}` | no |\n| routines | Routine (UDF/procedure) definitions | `map(object)` | `{}` | no |\n| access | Dataset access control list | `list(object)` | `[]` | no |\n| authorized_views | Authorized view access | `list(object)` | `[]` | no |\n| data_transfer_configs | Data transfer configurations | `map(object)` | `{}` | no |\n\n## Outputs\n\n| Name | Description |\n|------|-------------|\n| dataset_id | The dataset ID |\n| dataset_self_link | The URI of the dataset |\n| dataset_project | The project containing the dataset |\n| dataset_location | The geographic location |\n| table_ids | Map of table IDs to self links |\n| view_ids | Map of view IDs to self links |\n| materialized_view_ids | Map of materialized view IDs to self links |\n| external_table_ids | Map of external table IDs to self links |\n| routine_ids | Map of routine IDs |\n| transfer_config_names | Map of data transfer config names |\n\n## Examples\n\n- [Basic](examples/basic/) - Simple dataset with a table\n- [Advanced](examples/advanced/) - Dataset with partitioned tables, views, and IAM\n- [Complete](examples/complete/) - Full configuration with all resource types\n\n## License\n\nMIT License - Copyright (c) 2024 kogunlowo123\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkogunlowo123%2Fterraform-gcp-bigquery","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkogunlowo123%2Fterraform-gcp-bigquery","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkogunlowo123%2Fterraform-gcp-bigquery/lists"}