{"id":29200898,"url":"https://github.com/datopian/ckanext-datastore-bigquery","last_synced_at":"2025-07-30T06:12:51.308Z","repository":{"id":43396237,"uuid":"265241115","full_name":"datopian/ckanext-datastore-bigquery","owner":"datopian","description":"An extension that backs CKAN's datastore on Google BigQuery","archived":false,"fork":false,"pushed_at":"2025-05-29T18:05:37.000Z","size":203,"stargazers_count":10,"open_issues_count":3,"forks_count":3,"subscribers_count":9,"default_branch":"master","last_synced_at":"2025-07-02T11:13:46.098Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"agpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/datopian.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2020-05-19T12:28:09.000Z","updated_at":"2025-04-23T13:45:33.000Z","dependencies_parsed_at":"2025-04-20T23:21:23.865Z","dependency_job_id":"4850758f-4f28-40a0-a283-fbe7eb6d8e78","html_url":"https://github.com/datopian/ckanext-datastore-bigquery","commit_stats":null,"previous_names":[],"tags_count":12,"template":false,"template_full_name":null,"purl":"pkg:github/datopian/ckanext-datastore-bigquery","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datopian%2Fckanext-datastore-bigquery","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datopian%2Fckanext-datastore-bigquery/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datopian%2Fckanext-datastore-bigquery/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datopian%2Fckanext-datastore-bigquery/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/datopian","download_url":"https://codeload.github.com/datopian/ckanext-datastore-bigquery/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datopian%2Fckanext-datastore-bigquery/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":267820990,"owners_count":24149296,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-30T02:00:09.044Z","response_time":70,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-07-02T11:06:12.688Z","updated_at":"2025-07-30T06:12:51.300Z","avatar_url":"https://github.com/datopian.png","language":"Python","readme":"# ckanext-datastore-bigquery\n\nAn extension that enables `datastore_search` and `datastore_search_sql` API queries running against the data stored in Google Cloud BigQuery tables instead of standard CKAN datastore search queries ([ckan datastore api](https://docs.ckan.org/en/2.8/maintaining/datastore.html#the-datastore-api)).\n\n\n## Getting Started\n\nYou can run the extension like standalone instance on your local machine for development and tests purposes.\nAlso, you can use it as a ckan plugin instead of datastore standard plugin.\n\n### Prerequisites\n\nInstall the requirements:\n\n```\npip install requirements.txt\n```\n\nYou need to get your cloud credentials for the relevant\nservice from here: https://cloud.google.com/docs/authentication/getting-started\nThen save them to the json file.\n\n\n### Installation\n\nYou need CKAN instance running (tested with ckan v2.8.2).\n\nInstall extension:\n```\npip install ckanext-datastore-bigquery \u0026\u0026 \\\npip install google-cloud-bigquery\n```\n\nEnable the extension in CKAN by adding to your .ini file:\n\n```\nckan.plugins = bigquery\nckan.datastore.write_url = bigquery://id_of_your_bq_project\nckan.datastore.read_url = bigquery://id_of_your_bq_project\nckan.datastore.sqlsearch.enabled = True\nckanext.bigquery.google_cloud_credentials = path_to_your_cloud_credentials_json_file\nckanext.bigquery.project = id_of_your_bigquery_project\nckanext.bigquery.dataset id_of_your_bigquery_dataset\n\n```\n\n## Running tests\n\nPut the credentials file(taht you created in Prerequisites section) as:\n`.bigquery_test_credentials.json`\nat the root of your project.\n\nYou can run the tests for standalone instance:\n`pytest test`\n\nOr you can run tests in an integrated ckan plugin:\n`nosetests -v --ckan --with-pylons=test.ini ckanext`\n\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdatopian%2Fckanext-datastore-bigquery","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdatopian%2Fckanext-datastore-bigquery","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdatopian%2Fckanext-datastore-bigquery/lists"}