{"id":27147328,"url":"https://github.com/datatovalue/datatovalue-tools","last_synced_at":"2026-05-01T13:31:16.368Z","repository":{"id":286598640,"uuid":"904128109","full_name":"datatovalue/datatovalue-tools","owner":"datatovalue","description":"datatovalue-tools","archived":false,"fork":false,"pushed_at":"2025-06-09T12:03:15.000Z","size":169,"stargazers_count":11,"open_issues_count":0,"forks_count":2,"subscribers_count":2,"default_branch":"main","last_synced_at":"2026-04-22T15:39:22.335Z","etag":null,"topics":["bigquery","sql","terraform"],"latest_commit_sha":null,"homepage":"","language":"HCL","has_issues":false,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/datatovalue.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2024-12-16T09:58:09.000Z","updated_at":"2025-12-22T19:43:55.000Z","dependencies_parsed_at":"2025-04-07T12:21:42.555Z","dependency_job_id":"3254fae1-4a16-4f09-a74d-63b460aa0d17","html_url":"https://github.com/datatovalue/datatovalue-tools","commit_stats":null,"previous_names":["datatovalue/datatovalue-tools"],"tags_count":5,"template":false,"template_full_name":null,"purl":"pkg:github/datatovalue/datatovalue-tools","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datatovalue%2Fdatatovalue-tools","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datatovalue%2Fdatatovalue-tools/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datatovalue%2Fdatatovalue-tools/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datatovalue%2Fdatatovalue-tools/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/datatovalue","download_url":"https://codeload.github.com/datatovalue/datatovalue-tools/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datatovalue%2Fdatatovalue-tools/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32499681,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-30T13:12:12.517Z","status":"online","status_checked_at":"2026-05-01T02:00:05.856Z","response_time":64,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bigquery","sql","terraform"],"created_at":"2025-04-08T11:25:48.324Z","updated_at":"2026-05-01T13:31:16.360Z","avatar_url":"https://github.com/datatovalue.png","language":"HCL","funding_links":[],"categories":[],"sub_categories":[],"readme":"# datatovalue-tools\n\nThe **`datatovalue-tools`** library extends Google BigQuery to simplify common Analytics Engineering use-cases which we encounter daily  working with clients at [Data to Value](https://datatovalue.com/). \n\nMore specifically, the library comprises a set of utility functions to support data profiling, debugging, root-cause analysis and automation activities in data transformation and management. It is developed and maintained by the Engineering Team at Data to Value and is licensed under Apache 2.0. \n\nIf you are interested in making a contribution or suggestion, please contact `jim@datatovalue.com`.\n\n## Functions\nThe following sets of functions are deployed in the **datatovalue-tools** Google Cloud project, across all available regions.\n\nFunction Set | Description\n--- | ---\n[Metadata Functions](docs/metadata_functions.md) | Functions supporting metadata-based analysis and automation.\n[Monitor Functions](docs/monitor_functions.md) | Functions which are used to monitor BigQuery resources and resource status.\n[Profile Functions](docs/profile_functions.md) | Functions to support data quality assurance activities by modelling, integrating and analysing table contents and metadata.\n[JSON Functions](docs/json_functions.md) | Functions to support automatic schema parsing and JSON parser deployment, to support accurate data transfer and efficient data pipeline development.\n[SQL Parsers](docs/sql_parsers.md) | Functions which parse SQL queries and derive the logical structure and dependency graph.\n\n## Deployment\nFunctions are live and deployed across in the `datatovalue-tools` BigQuery project for all global regions and multi-regions. Note that the dataset names contain underscores instead of dashes (e.g. functions in `europe-north1` are in the dataset `datatovalue-tools.europe_north1`).\n\n## Permissions\nFunctions can be called by any user with `BigQuery Data Viewer`, `BigQuery Data User` or higher permissions on your source data. All authenticated users are permitted to call functions in the `datatovalue-tools` regional datasets.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdatatovalue%2Fdatatovalue-tools","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdatatovalue%2Fdatatovalue-tools","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdatatovalue%2Fdatatovalue-tools/lists"}