https://github.com/malloydata/bigquery_jobs
Model for information_schema.jobs in bigquery.
https://github.com/malloydata/bigquery_jobs
Last synced: about 1 year ago
JSON representation
Model for information_schema.jobs in bigquery.
- Host: GitHub
- URL: https://github.com/malloydata/bigquery_jobs
- Owner: malloydata
- License: mit
- Created: 2023-03-14T17:09:10.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2024-01-25T00:39:51.000Z (over 2 years ago)
- Last Synced: 2025-04-04T10:01:45.417Z (over 1 year ago)
- Language: Nix
- Size: 25.4 KB
- Stars: 4
- Watchers: 3
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# BigQuery Jobs Analysis
This is a Data Model for the [information_schema.jobs](https://cloud.google.com/bigquery/docs/information-schema-jobs) in BigQuery. It queries the BigQuery Information Schema to give you information about how your internal users are using BigQuery. What queries are they running, how much compute are they using, and which tables are the most frequently queried?
## Getting Started:
1. Open up [Google Cloud Code](https://shell.cloud.google.com/?show=ide)
1. Install the Malloy VS Code extension in your Cloud Code IDE
1. Clone this Git repository in your Cloud Code IDE
1. Modify [config.malloy](config.malloy) to point to your data
1. Open up the [dashboard.malloynb file](dashboard.malloynb) and run all the queries in the notebook.
## Using Malloy for Data Transformation
You can use your Malloy model to build governed views in your database, by embedding Malloy queries into `CREATE VIEW AS ...` SQL statements. The following files show how:
* [Create Views](create_views.malloysql) - this script persists a set of views in the database
* [SQL Examples](sql_examples.malloysql) - this script is an example of querying the views created above