{"id":32175828,"url":"https://github.com/benevolentai/guacamol","last_synced_at":"2025-10-21T19:49:23.275Z","repository":{"id":37733013,"uuid":"157866463","full_name":"BenevolentAI/guacamol","owner":"BenevolentAI","description":"Benchmarks for generative chemistry","archived":false,"fork":false,"pushed_at":"2024-02-11T08:59:38.000Z","size":98,"stargazers_count":482,"open_issues_count":13,"forks_count":95,"subscribers_count":15,"default_branch":"master","last_synced_at":"2025-10-21T19:49:06.012Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/BenevolentAI.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-11-16T12:45:21.000Z","updated_at":"2025-10-15T11:00:54.000Z","dependencies_parsed_at":"2024-06-18T20:07:58.366Z","dependency_job_id":"b1961f0c-decf-4338-89c2-1db0ace1eafe","html_url":"https://github.com/BenevolentAI/guacamol","commit_stats":{"total_commits":79,"total_committers":13,"mean_commits":6.076923076923077,"dds":"0.44303797468354433","last_synced_commit":"60ebe1f6a396f16e08b834dce448e9343d259feb"},"previous_names":[],"tags_count":14,"template":false,"template_full_name":null,"purl":"pkg:github/BenevolentAI/guacamol","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BenevolentAI%2Fguacamol","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BenevolentAI%2Fguacamol/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BenevolentAI%2Fguacamol/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BenevolentAI%2Fguacamol/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/BenevolentAI","download_url":"https://codeload.github.com/BenevolentAI/guacamol/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BenevolentAI%2Fguacamol/sbom","scorecard":{"id":21107,"data":{"date":"2025-08-11","repo":{"name":"github.com/BenevolentAI/guacamol","commit":"60ebe1f6a396f16e08b834dce448e9343d259feb"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":3.2,"checks":[{"name":"Token-Permissions","score":-1,"reason":"No tokens found","details":null,"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Code-Review","score":3,"reason":"Found 4/13 approved changesets -- score normalized to 3","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"Dangerous-Workflow","score":-1,"reason":"no workflows found","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: MIT License: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Vulnerabilities","score":10,"reason":"0 existing vulnerabilities detected","details":null,"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Pinned-Dependencies","score":0,"reason":"dependency not pinned by hash detected -- score normalized to 0","details":["Warn: containerImage not pinned by hash: dockers/Dockerfile:1: pin your Docker image by updating ubuntu:18.04 to ubuntu:18.04@sha256:152dc042452c496007f07ca9127571cb9c29697f42acbfad72324b2bb2e43c98","Warn: pipCommand not pinned by hash: dockers/Dockerfile:30","Warn: pipCommand not pinned by hash: dockers/Dockerfile:30","Warn: pipCommand not pinned by hash: dockers/Dockerfile:33","Warn: pipCommand not pinned by hash: dockers/Dockerfile:33","Info:   0 out of   1 containerImage dependencies pinned","Info:   0 out of   4 pipCommand dependencies pinned"],"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"Branch-Protection","score":0,"reason":"branch protection not enabled on development/release branches","details":["Warn: branch protection not enabled for branch 'master'"],"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 24 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}}]},"last_synced_at":"2025-08-14T16:49:21.028Z","repository_id":37733013,"created_at":"2025-08-14T16:49:21.028Z","updated_at":"2025-08-14T16:49:21.028Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":280325297,"owners_count":26311419,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-21T02:00:06.614Z","response_time":58,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-10-21T19:49:21.431Z","updated_at":"2025-10-21T19:49:23.267Z","avatar_url":"https://github.com/BenevolentAI.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# GuacaMol\n\n[![Build Status](https://travis-ci.com/BenevolentAI/guacamol.svg?branch=master)](https://travis-ci.com/BenevolentAI/guacamol)\n\n**GuacaMol** is an open source Python package for benchmarking of models for \n*de novo* molecular design.\n\nFor an in-depth explanation of the types of benchmarks and baseline scores,\nplease consult our paper \n[Benchmarking Models for De Novo Molecular Design](https://arxiv.org/abs/1811.09621)\n\n## Installation\n\nThe easiest way to install `guacamol` is with `pip`:\n```bash\npip install guacamol\n```\n\nDependencies:\n- `guacamol` requires the [RDKit library](http://rdkit.org/) (version `2018.09.1.0` or newer).\n- We also depend on the [FCD](https://github.com/bioinf-jku/FCD) library (version `1.1`) for the calculation of the Fréchet ChemNet Distance.\n\n#### Unit testing suite\n\nYou can test your installation of the guacamol benchmarking library by running the unit tests from this directory:\n```bash\npytest .\n```\n\n\n## Benchmarking models\n\nFor the distribution-learning benchmarks, specialize `DistributionMatchingGenerator` \n(from `guacamol.distribution_matching_generator`) for your model. \nInstances of this class must be able to generate molecules similar to the training set.  \nFor the actual benchmarks, call `assess_distribution_learning` \n(from `guacamol.assess_distribution_learning`) with an instance of your class. \nYou must also provide the location of the training set file (See section \"Data\" below).\n\nFor the goal-directed benchmarks, specialize `GoalDirectedGenerator` \n(from `guacamol.goal_directed_generator`) for your model. \nInstances of this class must be able to generate a specified number of molecules \nthat achieve high scores for a given scoring function.  \nFor the actual benchmarks, call `assess_goal_directed_generation` \n(from `guacamol.assess_goal_directed_generation`) with an instance of your class. \n\nExample implementations for baseline methods are available from https://github.com/BenevolentAI/guacamol_baselines.\n\nIn [guacamol_baselines](https://github.com/BenevolentAI/guacamol_baselines), \nwe provide a `Dockerfile` with an example environment for developing generative models and running guacamol.\n\n## Data\n\nFor fairness in the evaluation of the benchmarks and comparability of the results, \nyou should use a training set containing molecules from the ChEMBL dataset.\nFollow the procedure described below to get standardized datasets.\n\n\n### Download\n\nYou can download pre-built datasets [here](https://figshare.com/projects/GuacaMol/56639):\n\nmd5 `05ad85d871958a05c02ab51a4fde8530` [training](https://ndownloader.figshare.com/files/13612760 )  \nmd5 `e53db4bff7dc4784123ae6df72e3b1f0` [validation](https://ndownloader.figshare.com/files/13612766)  \nmd5 `677b757ccec4809febd83850b43e1616` [test](https://ndownloader.figshare.com/files/13612757)  \nmd5 `7d45bc95c33c10cb96ef5e78c38ac0b6` [all](https://ndownloader.figshare.com/files/13612745)  \n\n\n### Generation\n\nTo generate the training data yourself, run \n```\npython -m guacamol.data.get_data -o [output_directory]\n```\nwhich will download and process ChEMBL for you in your current folder.\n\nThis script will use the molecules from \n[`holdout_set_gcm_v1.smiles`](https://github.com/BenevolentAI/guacamol/blob/master/guacamol/data/holdout_set_gcm_v1.smiles)\nas a holdout set, and will exclude molecules very similar to these.\n\nDifferent versions of your Python packages may lead to differences in the generated dataset, which will cause the script to fail.\nSee the section below (\"Docker\") to reproducibly generate the standardized dataset with the hashes given above.\n\n### Docker\n\nTo be sure that you have the right dependencies you can build a Docker image, run from the top-level directory:\n```\ndocker build -t guacamol-deps -f dockers/Dockerfile .\n```\nThen you can run:\n```\ndocker run --rm -it  -v `pwd`:/guacamol -w /guacamol guacamol-deps python -m guacamol.data.get_data -o guacamol/data\n```\n\n## Change log\n- 1 May 2020: update version of FCD dependency\n- 15 Oct 2020: pin dependencies since FCD does not\n- 10 Nov 2021: relax pinned versions of keras, tensorflow \u0026 h5py dependencies\n- 20 Dec 2021: expose forbidden symbols argument for custom smiles dataset filtering\n\n## Leaderboard\n\nSee [https://www.benevolent.com/guacamol](https://www.benevolent.com/guacamol).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbenevolentai%2Fguacamol","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbenevolentai%2Fguacamol","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbenevolentai%2Fguacamol/lists"}