https://github.com/cloudquery/cloudrun-example

A reference for running CloudQuery syncs via Cloud Run
https://github.com/cloudquery/cloudrun-example

Last synced: about 2 months ago
JSON representation

A reference for running CloudQuery syncs via Cloud Run

• Host: GitHub
• URL: https://github.com/cloudquery/cloudrun-example
• Owner: cloudquery
• Created: 2023-05-23T11:22:58.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-04-03T09:42:14.000Z (9 months ago)
• Last Synced: 2024-04-17T16:18:49.413Z (9 months ago)
• Language: Go
• Size: 4.88 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# CloudQuery Cloud Run Example

This repository contains a small Docker file that starts a Web server on port 8080 for use with Cloud Run. When the server receives a request on the port, it starts a CloudQuery sync using a config file that should be mounted at `/secrets/config.yaml`.

You should also generate a CloudQuery API key and set it as an environment variable `CLOUDQUERY_API_KEY` in the [Cloud Run configuration](https://cloud.google.com/run/docs/configuring/services/secrets#access-secrets). See more information on generating an API key [here](https://docs.cloudquery.io/docs/deployment/generate-api-key).

## Deployment

This guide is still incomplete, but the rough steps are:

1. Build the image locally

   ```bash

   docker build --platform=linux/amd64 -t gcr.io/my-project/cloudquery-cloudrun:3.4.0 .

   ```

2. Upload the image to GCR:

   ```bash

   docker push gcr.io/my-project/cloudquery-cloudrun:3.4.0

   ```

3. Create a cloud run job using the newly pushed image. Make sure to mount your CloudQuery config file at `/secrets/config.yaml` (using Secrets). Note that it is possible to combine sources and destinations in a single config file by separating the sections with `---` (see [the docs](https://www.cloudquery.io/docs/core-concepts/configuration))

4. Schedule the job via [Cloud Scheduler](https://cloud.google.com/scheduler).