{"id":15036977,"url":"https://github.com/googlecloudplatform/bigquery-utils","last_synced_at":"2025-05-14T11:11:08.351Z","repository":{"id":37773762,"uuid":"201975309","full_name":"GoogleCloudPlatform/bigquery-utils","owner":"GoogleCloudPlatform","description":"Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.","archived":false,"fork":false,"pushed_at":"2025-05-01T21:11:27.000Z","size":30226,"stargazers_count":1205,"open_issues_count":50,"forks_count":302,"subscribers_count":65,"default_branch":"master","last_synced_at":"2025-05-01T22:22:57.977Z","etag":null,"topics":["bigquery","data-warehouse","google-cloud-platform","sql","utilities"],"latest_commit_sha":null,"homepage":"https://cloud.google.com/bigquery/","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/GoogleCloudPlatform.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2019-08-12T17:12:09.000Z","updated_at":"2025-05-01T16:41:57.000Z","dependencies_parsed_at":"2025-01-17T04:00:42.863Z","dependency_job_id":"b2e6797c-65b9-4507-aba7-92281bf3463e","html_url":"https://github.com/GoogleCloudPlatform/bigquery-utils","commit_stats":{"total_commits":315,"total_committers":75,"mean_commits":4.2,"dds":0.8698412698412699,"last_synced_commit":"09082672f8a35037f79a54d166cf17fca7792c6d"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GoogleCloudPlatform%2Fbigquery-utils","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GoogleCloudPlatform%2Fbigquery-utils/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GoogleCloudPlatform%2Fbigquery-utils/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GoogleCloudPlatform%2Fbigquery-utils/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/GoogleCloudPlatform","download_url":"https://codeload.github.com/GoogleCloudPlatform/bigquery-utils/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254129492,"owners_count":22019628,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bigquery","data-warehouse","google-cloud-platform","sql","utilities"],"created_at":"2024-09-24T20:32:55.412Z","updated_at":"2025-05-14T11:11:03.322Z","avatar_url":"https://github.com/GoogleCloudPlatform.png","language":"Jupyter Notebook","readme":"# BigQuery Utils\n\nBigQuery is a serverless, highly-scalable, and cost-effective cloud data\nwarehouse with an in-memory BI Engine and machine learning built in. This\nrepository provides useful utilities to assist you in migration and usage of\nBigQuery.\n\n[![Open in Cloud Shell](http://gstatic.com/cloudssh/images/open-btn.svg)](https://console.cloud.google.com/cloudshell/editor?cloudshell_git_repo=https%3A%2F%2Fgithub.com%2FGoogleCloudPlatform%2Fbigquery-utils.git)\n\n## Getting Started\n\nThis repository is broken up into:\n\n*   [Dashboards](/dashboards) - Pre-built dashboards for common use cases\n    *   [Geospatial](/dashboards/geospatial) - Colab notebooks for Geospatial Analytics.\n    *   [System Tables](/dashboards/system_tables) - Looker Studio Dashboards built on BigQuery's INFORMATION_SCHEMA metadata views to understand organization's slot and reservation utilization, job execution, and job errors.\n*   [Notebooks](/notebooks) - Colab notebooks for various BigQuery related use cases.\n*   [Performance Testing](/performance_testing) - Examples for doing performance testing\n    *   [JMeter](/performance_testing/jmeter) - Examples for using JMeter to test BigQuery performance\n*   [Scripts](/scripts) - Python, Shell, \u0026 SQL scripts\n    *   [billing](/scripts/billing) - Example queries over the GCP billing\n        export\n    *   [optimization](/scripts/optimization) - Scripts to help identify areas for optimization in your BigQuery warehouse.\n*   [Stored Procedures](/stored_procedures) - Example stored procedures\n*   [Third Party](/third_party) - Relevant third party libraries for BigQuery\n    *   [compilerworks](/third_party/compilerworks) - BigQuery UDFs which mimic the behavior of proprietary functions in other databases\n*   [Tools](/tools) - Custom tooling for working with BigQuery\n    *   [Cloud Functions](/tools/cloud_functions) - Cloud Functions to automate common use cases\n*   [UDFs](/udfs) - User-defined functions for common usage as well as migration\n    *   [community](/udfs/community) - Community contributed user-defined\n        functions\n    *   [datasketches](/udfs/datasketches) - UDFs deployed from the latest release of [Apache Datasketches for BigQuery](https://github.com/apache/datasketches-bigquery)\n    *   [migration](/udfs/migration) - UDFs which mimic the behavior of\n        proprietary functions in the following databases:\n        *   [netezza](/udfs/migration/netezza)\n        *   [oracle](/udfs/migration/oracle)\n        *   [redshift](/udfs/migration/redshift)\n        *   [snowflake](/udfs/migration/snowflake)\n        *   [teradata](/udfs/migration/teradata)\n        *   [vertica](/udfs/migration/vertica)\n        *   [sqlserver](/udfs/migration/sqlserver)\n*   [Views](/views) - Views over system tables such as audit logs or the\n    `INFORMATION_SCHEMA`\n    *   [query_audit](/views/audit/query_audit.sql) - View to simplify querying\n        the audit logs which can be used to power dashboards\n        ([example](https://codelabs.developers.google.com/codelabs/bigquery-pricing-workshop/#0)).\n\n\n## Public UDFs\n\nFor more information on UDFs and using those provided in the repository with\nBigQuery, see the [README](/udfs/README.md) in the [udfs](/udfs) folder.\n\n## Contributing\n\nSee the contributing [instructions](/CONTRIBUTING.md) to get started\ncontributing.\n\nTo contribute UDFs to this repository, see the\n[instructions](/udfs/CONTRIBUTING.md) in the [udfs](/udfs) folder.\n\n## License\n\nExcept as otherwise noted, the solutions within this repository are provided under the\n[Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0) license. Please see\nthe [LICENSE](/LICENSE) file for more detailed terms and conditions.\n\n## Disclaimer\n\nThis repository and its contents are not an official Google Product.\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgooglecloudplatform%2Fbigquery-utils","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgooglecloudplatform%2Fbigquery-utils","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgooglecloudplatform%2Fbigquery-utils/lists"}