{"id":24456119,"url":"https://github.com/arthurdjn/scrape-goodreads","last_synced_at":"2025-10-01T17:31:05.704Z","repository":{"id":57464623,"uuid":"265892872","full_name":"arthurdjn/scrape-goodreads","owner":"arthurdjn","description":"Python package to scrape data from goodreads.com website. Authors, Books, and Quotes can be extracted.","archived":false,"fork":false,"pushed_at":"2020-05-23T12:28:29.000Z","size":242,"stargazers_count":3,"open_issues_count":1,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-08-25T22:51:40.620Z","etag":null,"topics":["beautifulsoup","books","goodreads","python","quote","quotes","scrape-goodreads","scraper"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/arthurdjn.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-05-21T16:05:25.000Z","updated_at":"2023-09-20T22:24:22.000Z","dependencies_parsed_at":"2022-08-31T03:11:07.557Z","dependency_job_id":null,"html_url":"https://github.com/arthurdjn/scrape-goodreads","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/arthurdjn/scrape-goodreads","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthurdjn%2Fscrape-goodreads","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthurdjn%2Fscrape-goodreads/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthurdjn%2Fscrape-goodreads/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthurdjn%2Fscrape-goodreads/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/arthurdjn","download_url":"https://codeload.github.com/arthurdjn/scrape-goodreads/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arthurdjn%2Fscrape-goodreads/sbom","scorecard":{"id":209274,"data":{"date":"2025-08-11","repo":{"name":"github.com/arthurdjn/scrape-goodreads","commit":"be0d81ef0be09955599a3fae43648e9945923ff1"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":2.3,"checks":[{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Token-Permissions","score":-1,"reason":"No tokens found","details":null,"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Dangerous-Workflow","score":-1,"reason":"no workflows found","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Code-Review","score":0,"reason":"Found 0/21 approved changesets -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"SAST","score":0,"reason":"no SAST tool detected","details":["Warn: no pull requests merged into dev branch"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}},{"name":"Pinned-Dependencies","score":-1,"reason":"no dependencies found","details":null,"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: MIT License: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"Branch-Protection","score":0,"reason":"branch protection not enabled on development/release branches","details":["Warn: branch protection not enabled for branch 'master'"],"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"Vulnerabilities","score":4,"reason":"6 existing vulnerabilities detected","details":["Warn: Project is vulnerable to: GHSA-34jh-p97f-mpxf","Warn: Project is vulnerable to: PYSEC-2023-212 / GHSA-g4mx-q9vg-27p4","Warn: Project is vulnerable to: GHSA-pq67-6m6q-mj2v","Warn: Project is vulnerable to: PYSEC-2023-192 / GHSA-v845-jxx5-vc9f","Warn: Project is vulnerable to: PYSEC-2020-148 / GHSA-wqvq-5m8c-6g24","Warn: Project is vulnerable to: PYSEC-2021-108"],"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}}]},"last_synced_at":"2025-08-17T00:26:27.226Z","repository_id":57464623,"created_at":"2025-08-17T00:26:27.226Z","updated_at":"2025-08-17T00:26:27.226Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":277520243,"owners_count":25832374,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-09-29T02:00:09.175Z","response_time":84,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup","books","goodreads","python","quote","quotes","scrape-goodreads","scraper"],"created_at":"2025-01-21T02:15:25.349Z","updated_at":"2025-10-01T17:31:05.415Z","avatar_url":"https://github.com/arthurdjn.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![](https://img.shields.io/readthedocs/scrapereads)](https://scrapereads.readthedocs.io/en/latest/)\n[![](https://img.shields.io/pypi/v/scrapereads)](https://pypi.org/project/scrapereads/)\n![](https://img.shields.io/pypi/status/scrapereads)\n\n\n# scrape-goodreads\nPython package to scrape data from goodreads.com website. Authors, Books, and Quotes can be extracted.\n\n*Project made during a Deep Learning project for poem generation using GPT2 model.*\n\n\n# Installation\n\nInstall *scrapereads* package from *PyPi*:\n\n```\npip install scrapereads\n```\n\nOr from *GitHub*:\n\n```\ngit clone https://github.com/arthurdjn/scrape-goodreads\ncd scrape-goodreads\npip install .\n```\n\n# Getting Started\n\n## GoodReads API\n\nYou can search for ``Author``, ``Book`` or ``Quote`` from the API:\n\n```python\nfrom scrapereads import GoodReads\n\n# Connect to the API\ngoodreads = GoodReads()\n\n# Search for an author, from it's ID.\nAUTHOR_ID = 3389\nauthor = goodreads.search_author(AUTHOR_ID)\n# Search for a book\nBOOK_ID = 3048970\nbook = goodreads.search_book(AUTHOR_ID, BOOK_ID)\n# Look for the 10 first books (set it to ``top_k=None`` to turn it off)\nbooks = goodreads.search_books(AUTHOR_ID, top_k=10)\n# ...Or quotes\nquotes = goodreads.search_quotes(AUTHOR_ID, top_k=5)\n```\n\nQuotes are made of a text, but optional information can be added (like number of likes, tags,\nreference etc.)\n\n```python\nquotes = goodreads.search_quotes(AUTHOR_ID, top_k=5)\n\nfor quote in quotes:\n    print(quote)\n    print()\n```\nOutput:\n```pycon\n\"Books are a uniquely portable magic.\"\n- Stephen King, from \"On Writing: A Memoir Of The Craft\"\n  Likes: 16225, Tags: books, magic, reading\n\n\"If you don't have time to read, you don't have the time (or the tools) to write. Simple as that.\"\n- Stephen King\n  Likes: 12565, Tags: reading, writing\n\n\"Get busy living or get busy dying.\"\n- Stephen King, from \"Different Seasons\"\n  Likes: 9014, Tags: life\n\n\"Books are the perfect entertainment: no commercials, no batteries, hours of enjoyment for each dollar spent. What I wonder is why everybody doesn't carry a book around for those inevitable dead spots in life.\"\n- Stephen King\n  Likes: 8667, Tags: books\n\n\"When his life was ruined, his family killed, his farm destroyed, Job knelt down on the ground and yelled up to the heavens, \"Why god? Why me?\" and the thundering voice of God answered, There's just something about you that pisses me off.\"\n- Stephen King, from \"Storm Of The Century\"\n  Likes: 7686, Tags: god, humor, religion\n```\n\n## Structure\n\nThe package is divided as follows:\n\n* Author\n* Book, inherits from Author\n* Quote, inherits from Book\n\nThey share an abstract structure with AuthorMeta, BookMeta, QuoteMeta.\n\n## Retrieve data\n\n\nOnce you have one of these objects, you can also access data directly through their methods:\n\n```python\nauthor = goodreads.search_author(AUTHOR_ID)\nbooks = author.get_books()\nquotes = author.get_quotes()\n\n# Idem from an book\nbook = goodreads.search_book(AUTHOR_ID, BOOK_ID)\nquotes = book.get_quotes()\n```\n\n\nIn addition, you can retrieve parent objects from children:\n\n```python\nauthor = goodreads.search_author(AUTHOR_ID)\nquotes = author.get_quotes(top_k=10)\nquote = quotes[0]\n\n# Access to parent classes\nbook = quote.get_book()\nauthor = quote.get_author()\n```\n\nYou can scrape for description, links and other details information:\n\n```python\nauthor = goodreads.search_author(AUTHOR_ID)\ninfo = author.get_info()  # description of the author (genre, description, references etc.)\n```\n\nYou can finally retrieve similar authors from an author with:\n\n```python\nauthor = goodreads.search_author(AUTHOR_ID)\nauthors = author.get_similar_authors(top_k=5)\n```\n\n## Save and export\n\nYou can save data in a JSON format (and encode it to ASCII if you want).\n\n```python\nauthor = goodreads.search_author(AUTHOR_ID)\nauthor_data = author.to_json(encode='ascii')\n# Idem for book and quote\n```\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farthurdjn%2Fscrape-goodreads","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Farthurdjn%2Fscrape-goodreads","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farthurdjn%2Fscrape-goodreads/lists"}