{"id":19119762,"url":"https://github.com/wintermi/bqwrite-test","last_synced_at":"2026-03-12T00:03:49.275Z","repository":{"id":57655984,"uuid":"427842990","full_name":"wintermi/bqwrite-test","owner":"wintermi","description":"A command line application designed to provide a method to test the BigQuery Streaming API or BigQuery Storage Write API, allowing you to get a view of the potential throughput available via a given host.","archived":false,"fork":false,"pushed_at":"2025-04-21T12:31:34.000Z","size":211,"stargazers_count":3,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-04-27T00:26:16.086Z","etag":null,"topics":["bigquery","google-cloud","google-cloud-platform"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/wintermi.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-11-14T05:10:30.000Z","updated_at":"2025-04-21T12:31:37.000Z","dependencies_parsed_at":"2024-02-10T05:18:52.171Z","dependency_job_id":"2c69659f-da7f-4f6f-980e-65b65b302d8a","html_url":"https://github.com/wintermi/bqwrite-test","commit_stats":{"total_commits":55,"total_committers":2,"mean_commits":27.5,"dds":0.2909090909090909,"last_synced_commit":"6a326fb57b163ab6685d9e664c4c5a2456ba08e3"},"previous_names":["winterlabs-dev/bqwrite-test"],"tags_count":5,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wintermi%2Fbqwrite-test","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wintermi%2Fbqwrite-test/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wintermi%2Fbqwrite-test/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wintermi%2Fbqwrite-test/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/wintermi","download_url":"https://codeload.github.com/wintermi/bqwrite-test/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252522714,"owners_count":21761783,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bigquery","google-cloud","google-cloud-platform"],"created_at":"2024-11-09T05:11:01.855Z","updated_at":"2026-03-12T00:03:47.223Z","avatar_url":"https://github.com/wintermi.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# BigQuery Streaming API Test Client\n\n[![Workflows](https://github.com/wintermi/bqwrite-test/workflows/Go%20-%20Build/badge.svg)](https://github.com/wintermi/bqwrite-test/actions)\n[![Go Report](https://goreportcard.com/badge/github.com/wintermi/bqwrite-test)](https://goreportcard.com/report/github.com/wintermi/bqwrite-test)\n[![License](https://img.shields.io/github/license/wintermi/bqwrite-test.svg)](https://github.com/wintermi/bqwrite-test/blob/main/LICENSE)\n[![Release](https://img.shields.io/github/v/release/wintermi/bqwrite-test?include_prereleases)](https://github.com/wintermi/bqwrite-test/releases)\n\n\n## Description\n\nA command line application designed to provide a method to test the BigQuery Streaming API or BigQuery Storage Write API, allowing you to get a view of the potential throughput available via a given host.\n\n```\nUSAGE:\n    bqwrite-test -p PROJECT_ID -d DATASET -t TABLENAME -w WORKERS\n\nARGS:\n  -b int\n    \tBatch Size, 1 to 50000 (default 1)\n  -d string\n    \tBigQuery Dataset  (Required)\n  -i int\n    \tNumber of Records, 1 to 100000000 (default 100)\n  -o\tOverwrite BigQuery Table\n  -p string\n    \tGoogle Cloud Project ID  (Required)\n  -t string\n    \tBigQuery Table (default \"bqwrite_test\")\n  -v\tOutput Verbose Detail\n  -w int\n    \tNumber of Parallel Workers, 1 to 100 (default 5)\n```\n\n## BigQuery Table\n\nWhen you first execute the command line application it will verify if the target table exists, if not found then the table will be created.\n\nIf you wish to delete and recreate the existing table you can execute the command with the `-o` overwrite flag.\n\n## Known Limitations\n\nBecause BigQuery's Streaming API is designed for high insertion rates, modifications to the underlying table metadata exhibit are eventually consistent when interacting with the streaming system.\n\nBecause of this, when overwriting or creating the table initially a 10 minute sleep is performed.\n\n\n## License\n\n**bqwrite-test** is released under the [Apache License 2.0](https://github.com/wintermi/bqwrite-test/blob/main/LICENSE) unless explicitly mentioned in the file header.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwintermi%2Fbqwrite-test","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fwintermi%2Fbqwrite-test","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwintermi%2Fbqwrite-test/lists"}