{"id":23032326,"url":"https://github.com/michaelfromyeg/recesearch","last_synced_at":"2025-06-11T05:07:22.085Z","repository":{"id":44866424,"uuid":"276971045","full_name":"michaelfromyeg/rECEsearch","owner":"michaelfromyeg","description":"A simple Python project to grab Google Scholar data for research at UBC.","archived":false,"fork":false,"pushed_at":"2023-02-11T00:30:22.000Z","size":161,"stargazers_count":3,"open_issues_count":6,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-04-02T21:42:47.959Z","etag":null,"topics":["ece","python","scholarly"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/michaelfromyeg.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-07-03T19:13:00.000Z","updated_at":"2023-03-04T04:36:43.000Z","dependencies_parsed_at":"2024-12-15T15:52:04.070Z","dependency_job_id":"96808aba-a2c2-492e-b016-b1f9defe6e4d","html_url":"https://github.com/michaelfromyeg/rECEsearch","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/michaelfromyeg%2FrECEsearch","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/michaelfromyeg%2FrECEsearch/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/michaelfromyeg%2FrECEsearch/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/michaelfromyeg%2FrECEsearch/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/michaelfromyeg","download_url":"https://codeload.github.com/michaelfromyeg/rECEsearch/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/michaelfromyeg%2FrECEsearch/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":259204809,"owners_count":22821160,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ece","python","scholarly"],"created_at":"2024-12-15T15:52:00.020Z","updated_at":"2025-06-11T05:07:22.060Z","avatar_url":"https://github.com/michaelfromyeg.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# rECEsearch\n\nA simple Python project to grab Google Scholar data for research at UBC.\n\n[![made-with-python](https://img.shields.io/badge/Made%20with-Python-1f425f.svg)](https://www.python.org/) [![MIT license](https://img.shields.io/badge/License-MIT-blue.svg)](https://lbesson.mit-license.org/)\n\n## Requirements\n\n- Python\n- scholarly (in lieu of a Google Scholar API)\n- Data, in the form a csv file\n\nExample CSV data:\n\n```csv\nLab,                      ID,           URL\nBiomedical Technologies,  ZImFmCUAAAAJ, http://ece.sites.olt.ubc.ca/research/biomedical-technologies/\nCommunication Systems,    PhdzKFcAAAAJ, http://ece.sites.olt.ubc.ca/research/communication-systems/\n```\n\n(Do not include the spaces if you choose to use this data.)\n\nVirtual environment quick start (for Windows):\n\n```bash\npip install virtualenv\nvirtualenv env\nsource ./env/Scripts/activate\npip install -r requirements.txt\npip freeze \u003e requirements.txt\n```\n\n### N.B.: As of July 10th, 2020 you should manually tweak the scholarly package to get the desired output from research.py\n\nThere's an open issue for this, but for now go to `env/Lib/scholarly/author.py` and change line 10 to read:\n\n```python\n_CITATIONAUTH = '/citations?hl=en\u0026user={0}\u0026sortby=pubdate'\n```\n\nThe \"sortby=pubdate\" is what we're after here.\n\n### And, as of August 8th, 2020 you should manually tweak one more thing\n\nIn `_scholarly.py` change line 85 to contain:\n\n`patents: bool = False`\n\nPatents should be skipped for this use case.\n\n## Usage\n\nRun `python research.py -i \u003cinput file\u003e -o \u003coutput file\u003e`, where 'input file' is the name of a CSV file containing professor names. See `research.py` for more information on the anticipated structure of the CSV data. In general, your input file should have three columns: lab, lab ID, and a URL (in that order).\n\n- 'Lab' should be the name of the lab at UBC\n- 'Lab ID' should be the Google Scholar ID. For example, if you navigate to [this](https://scholar.google.com/citations?user=EmD_lTEAAAAJ\u0026hl=en) link you want the `user=...` part of the link, so in this case the ID is `EmD_lTEAAAAJ`.\n- 'URL' should be the homepage this content is displayed on the UBC website. As of right now, this field is *not* utilized, so don't worry about it to much.\n  \nAfter executing the command, an output CSV file is produced.\n\n- 'Lab' and 'Lab ID' are the same as above\n- 'Publications' is a kind-of placeholder for an arbitrary amount of rows (like a file tree); the publication information is printed in the next N rows with the following (rather self-explanatory) headers:\n  - 'Title'\n  - 'Author'\n  - 'Year'\n  - 'Cited by' (the number of other publications that have cited the give publication)\n  - 'Publisher'\n\n### Example\n\nHere's an example console call:\n\n![Example console output](./images/console.png)\n\nAnd then here would be the generated csv (converted to a Markdown table):\n\n|Lab                    |Lab ID      |Publications|Title                                                                       |Author              |Year|Cited By|Publisher       |\n|-----------------------|------------|------------|----------------------------------------------------------------------------|--------------------|----|--------|----------------|\n|Biomedical Technologies|ZImFmCUAAAAJ|...         |                                                                            |                    |    |        |                |\n|                       |            |            |Guidelines for the use and interpretation of assays for monitoring autophagy|Daniel J Klionsky an|2016|8739    |Taylor \u0026 Francis|\n|                       |            |            |On robust Capon beamforming and diagonal loading                            |Jian Li and Petre St|2003|1431    |IEEE            |\n\nOr, in Excel:\n\n![Example program output](./images/output2.png)\n\n## Future\n\nCollect research from more sources, export to RSS feed.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmichaelfromyeg%2Frecesearch","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmichaelfromyeg%2Frecesearch","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmichaelfromyeg%2Frecesearch/lists"}