{"id":26356527,"url":"https://github.com/ds4sd/deepsearch4czi","last_synced_at":"2025-08-20T19:08:40.743Z","repository":{"id":203789516,"uuid":"709928087","full_name":"DS4SD/deepsearch4czi","owner":"DS4SD","description":"Repository to detect scientific software in documents for Chan Zuckerberg Initiative workshop","archived":false,"fork":false,"pushed_at":"2023-10-26T22:41:21.000Z","size":50,"stargazers_count":2,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-06-09T22:04:57.790Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/DS4SD.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-10-25T17:10:48.000Z","updated_at":"2024-11-03T17:49:34.000Z","dependencies_parsed_at":null,"dependency_job_id":"b6c8b03e-e36a-44c1-9e5f-9b8874249f1f","html_url":"https://github.com/DS4SD/deepsearch4czi","commit_stats":null,"previous_names":["ds4sd/deepsearch4czi"],"tags_count":0,"template":false,"template_full_name":"chanzuckerberg/Hackathon-Template","purl":"pkg:github/DS4SD/deepsearch4czi","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DS4SD%2Fdeepsearch4czi","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DS4SD%2Fdeepsearch4czi/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DS4SD%2Fdeepsearch4czi/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DS4SD%2Fdeepsearch4czi/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/DS4SD","download_url":"https://codeload.github.com/DS4SD/deepsearch4czi/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DS4SD%2Fdeepsearch4czi/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":268505768,"owners_count":24260962,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-03T02:00:12.545Z","response_time":2577,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-03-16T13:30:54.891Z","updated_at":"2025-08-03T06:39:04.477Z","avatar_url":"https://github.com/DS4SD.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# DeepSearch for CZI Hackathon\n\nThis repository was made during a workshop at the Chan Zuckerberg Initiave in order to showcase how Deep Search can effectively be used to extract software/github mentions in scientific literature.\n\n## Getting started\n\nFirst, authenticate with the open-access DS PDF converter,\n\n```sh\ndeepsearch profile config --profile-name \"ds-experience\" --host \"https://deepsearch-experience.res.ibm.com/\" --verify-ssl --username \"\u003cyour-email-address\u003e\"\n```\n\n## Running\n\nTo convert PDF documents in the folder `data`, \n\n```sh\npoetry run python ./ds4czi/convert_pdfs.py -i ./data\n```\n\nTo search and download articles (mentioning \"Yolov5\") in the Arxiv and storing them in folder `./data/Yolov5`,\n\n```sh\npoetry run python ./ds4czi/search_articles.py -i arxiv -q Yolov5 -o ./data/Yolov5\n```\n\nTo extract software mentions from a set of converted documents,\n\n```sh\npoetry run python ./ds4czi/extract_software.py -i ./data/Yolov5/arxiv/json/\n```\n\n## About this project\n\nThis repository was developed as part of the [Mapping the Impact of Research Software in Science](https://github.com/chanzuckerberg/software-impact-hackathon-2023) hackathon hosted by the Chan Zuckerberg Initiative (CZI). By participating in this hackathon, owners of this repository acknowledge the following:\n\n1. The code for this project is hosted by the project contributors in a repository created from a template generated by CZI. The purpose of this template is to help ensure that repositories adhere to the hackathon’s project naming conventions and licensing recommendations.  CZI does not claim any ownership or intellectual property on the outputs of the hackathon. This repository allows the contributing teams to maintain ownership of code after the project, and indicates that the code produced is not a CZI product, and CZI does not assume responsibility for assuring the legality, usability, safety, or security of the code produced.\n2. This project is published under a MIT license.\n\n## Code of Conduct\n\nContributions to this project are subject to CZI’s Contributor Covenant [code of conduct](https://github.com/chanzuckerberg/.github/blob/master/CODE_OF_CONDUCT.md). By participating, contributors are expected to uphold this code of conduct. \n\n## Reporting Security Issues\n\nIf you believe you have found a security issue, please responsibly disclose by contacting the repository owner via the ‘security’ tab above.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fds4sd%2Fdeepsearch4czi","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fds4sd%2Fdeepsearch4czi","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fds4sd%2Fdeepsearch4czi/lists"}