{"id":15959145,"url":"https://github.com/nickstenning/epsrc-gow","last_synced_at":"2025-04-04T10:58:26.426Z","repository":{"id":1405472,"uuid":"1455075","full_name":"nickstenning/epsrc-gow","owner":"nickstenning","description":"A scrape of data from the UK Engineering and Physical Sciences Research Council \"Grants on the Web\" service.","archived":false,"fork":false,"pushed_at":"2011-07-14T23:10:43.000Z","size":170,"stargazers_count":2,"open_issues_count":0,"forks_count":1,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-02-09T21:12:11.909Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":"davetroy/geohash","license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/nickstenning.png","metadata":{"files":{"readme":"README.mkd","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2011-03-08T15:39:05.000Z","updated_at":"2017-05-29T16:27:37.000Z","dependencies_parsed_at":"2022-07-07T11:33:01.781Z","dependency_job_id":null,"html_url":"https://github.com/nickstenning/epsrc-gow","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nickstenning%2Fepsrc-gow","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nickstenning%2Fepsrc-gow/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nickstenning%2Fepsrc-gow/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nickstenning%2Fepsrc-gow/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nickstenning","download_url":"https://codeload.github.com/nickstenning/epsrc-gow/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247166157,"owners_count":20894652,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-07T14:40:29.899Z","updated_at":"2025-04-04T10:58:26.412Z","avatar_url":"https://github.com/nickstenning.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# [EPSRC Past Grant portfolio](http://gow.epsrc.ac.uk/SearchPastGrant.aspx)\n\nAs of 2011-03-08, the EPSRC \"Grants on the Web\" database contains grants dating back to 1985:\n\n- 35,966 grants\n- £6,055,173,655 of committed funding\n\nThis repository contains tools for scraping and manipulating this data into a useful format.\n\n## Quick access\n\nInstead of using the code in this repository, why not download the database generated by it? A listing of these can be found [at CKAN](http://storage.ckan.net/epsrc-gow).\n\n- [Latest database](http://storage.ckan.net/epsrc-gow/grants-20110310.sql.bz2) (SQL format, updated 2011-03-10)\n- [Extra grants detail](http://storage.ckan.net/epsrc-gow/grants-detail-20110311.yaml.bz2) (YAML format, updated 2011-03-11)\n\n## Setup\n\nTo get up and running, you will need `python` and `pip`. Instructions for installing `python` are beyond the scope of this document, but you should be able to get `pip` if you don't have it by running:\n\n    $ easy_install pip\n\nIf you use `virtualenv`, you might want to create an environment to play around in:\n\n    $ virtualenv --distribute pyenv\n    $ source pyenv/bin/activate\n\nNow install the scraper and its dependencies:\n\n    $ pip install -e .\n\nCreate the database (or migrate your existing database to the current schema version) by running:\n\n    $ ./migrate.sh epsrc.db 3\n\n## Usage\n\nTo get a database of basic grants information for the financial year beginning 1 Apr 1993, run:\n\n    $ epsrc-scrape --basic --year 1993 epsrc.db\n\nMore usefully, to download all the information in the EPSRC GOW repository (this will take a long time to complete):\n\n    $ epsrc-scrape epsrc.db\n\nEach grant has a unique grant reference, e.g. `GR/J50118/01`. We can check that the example grant above made it into the database with the following command\n\n    $ sqlite3 -line epsrc.db \"select * from grants where id='GR/J50118/01'\"\n                           id = GR/J50118/01\n                        title = USE OF CATALYTIC MEMBRANES FOR IN SITU REACTION AND SEPARATION\n                        value = 114608\n    principal_investigator_id = 40792\n                department_id = 5273\n                   created_at = 2011-06-16 12:36:35.164790\n                  modified_at = 2011-06-16 12:36:35.164800\n\n## Warnings\n\nBe careful with the data this scraper generates. Care has been taken to sanitize the data, but as with any scraper, there may be inconsistencies or missing entries. Please [let me know](https://github.com/nickstenning/epsrc-gow/issues) if you find any problems.\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnickstenning%2Fepsrc-gow","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnickstenning%2Fepsrc-gow","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnickstenning%2Fepsrc-gow/lists"}