https://github.com/airbytehq/terraform-airbyte-bigquery-destination

Terraform Module for Setting Up BigQuery Destination with Airbyte
https://github.com/airbytehq/terraform-airbyte-bigquery-destination

airbyte bigquery elt etl terraform

Last synced: about 1 month ago
JSON representation

Terraform Module for Setting Up BigQuery Destination with Airbyte

• Host: GitHub
• URL: https://github.com/airbytehq/terraform-airbyte-bigquery-destination
• Owner: airbytehq
• License: mit
• Created: 2023-07-19T18:25:31.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-08-29T20:20:22.000Z (over 1 year ago)
• Last Synced: 2024-11-10T09:34:40.533Z (3 months ago)
• Topics: airbyte, bigquery, elt, etl, terraform
• Language: HCL
• Homepage: https://docs.airbyte.com/integrations/destinations/bigquery/
• Size: 21.5 KB
• Stars: 0
• Watchers: 6
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Setup a BigQuery Destination in Airbyte

This module will create everything needed to set up a BigQuery destination. This includes:

- A Google Service Account for accessing BigQuery and GCS data

- Credentials for that service account

- A BigQuery destination in [Airbyte Cloud](https://airbyte.com/solutions/airbyte-cloud) or [Airbyte OSS](https://airbyte.com/oss-vs-cloud-vs-enterprise) to be in used in [Connections](https://docs.airbyte.com/understanding-airbyte/connections/)

There are two different loading methods for BigQuery, Standard inserts or GCS Staging. GCS staging is more performant and the method Airbyte recommends, so this module defaults to GCS Staging.

See the `./examples` directory for examples to both create a new dataset or use an existing one.