{"id":18676881,"url":"https://github.com/chusiang/crawler-book-info","last_synced_at":"2025-04-12T02:24:37.548Z","repository":{"id":48685864,"uuid":"83518110","full_name":"chusiang/crawler-book-info","owner":"chusiang","description":"A crawler for quick parser the book information","archived":false,"fork":false,"pushed_at":"2024-06-24T14:07:36.000Z","size":95,"stargazers_count":5,"open_issues_count":2,"forks_count":1,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-04-12T02:24:33.545Z","etag":null,"topics":["book","crawler","python"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/chusiang.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-03-01T06:03:53.000Z","updated_at":"2024-06-24T14:07:40.000Z","dependencies_parsed_at":"2023-01-29T15:30:21.073Z","dependency_job_id":"2e22d792-a5b4-4712-85a8-a4353f5c3d11","html_url":"https://github.com/chusiang/crawler-book-info","commit_stats":null,"previous_names":[],"tags_count":9,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chusiang%2Fcrawler-book-info","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chusiang%2Fcrawler-book-info/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chusiang%2Fcrawler-book-info/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chusiang%2Fcrawler-book-info/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/chusiang","download_url":"https://codeload.github.com/chusiang/crawler-book-info/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248506277,"owners_count":21115409,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["book","crawler","python"],"created_at":"2024-11-07T09:31:33.281Z","updated_at":"2025-04-12T02:24:37.521Z","avatar_url":"https://github.com/chusiang.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Crawler Book Info\n\n[![Travis CI](https://travis-ci.org/chusiang/crawler-book-info.svg?branch=main)](https://travis-ci.org/chusiang/crawler-book-info) [![Python Version](https://img.shields.io/badge/python-3.11-blue.svg)](https://hub.docker.com/r/chusiang/crawler-book-info/)\n[![Docker Hub](https://img.shields.io/badge/docker-chusiang%2Fcrawler--book--info-blue.svg)](https://hub.docker.com/r/chusiang/crawler-book-info/) [![Download Size](https://images.microbadger.com/badges/image/chusiang/crawler-book-info.svg)](https://microbadger.com/images/chusiang/crawler-book-info \"Get your own image badge on microbadger.com\") [![License: MIT](https://img.shields.io/badge/License-MIT-lightgrey.svg)](LICENSE)\n\nA sample crawler for quick parser some books information.\n\n## Initialization\n\n1. Install the [pyenv][pyenv] and [pyenv-virtualenv][py-venv].\n1. create virtualenv of `py3`.\n\n    ``` shell\n    [ jonny@xenial ~/vcs/crawler-book-outline ]\n    $ pyenv virtualenv 3.9.6 py3\n    ```\n\n1. Use `py3` virtualenv under this directory.\n\n    ``` shell\n    [ jonny@xenial ~/vcs/crawler-book-outline ]\n    $ pyenv local py3\n    ```\n\n1. Install packages with pip.\n\n    ``` shell\n    (py3) [ jonny@xenial ~/vcs/crawler-book-outline ]\n    $ pip3 install -r requirements.txt\n    ```\n\n[pyenv]: https://github.com/pyenv/pyenv-virtualenv\n[py-venv]: https://github.com/pyenv/pyenv-virtualenv\n\n## Usage\n\n### tenlong.com.tw\n\n1. Run crawler with **ISBN-13**.\n\n    ``` shell\n    (.py3) [ jonny@xenial ~/vcs/crawler-book-outline ]\n    $ python3 tenlong.py 9781491915325\n    ```\n\n### books.com.tw\n\n1. Run crawler with **url**.\n\n    ``` shell\n    (py3) [ jonny@xenial ~/vcs/crawler-book-outline ]\n    $ python3 books.py https://www.books.com.tw/products/0010810939\n    ```\n\n1. Run crawler with **product number**.\n\n    ``` shell\n    (py3) [ jonny@xenial ~/vcs/crawler-book-outline ]\n    $ python3 books.py 0010810939\n    ```\n\n\u003e Not support the **ISBN-13** args yet on books.com.tw.\n\n### View Result\n\n1. Open html via Firefox on GNU/Linux.\n\n    ``` shell\n    (py3) [ jonny@xenial ~/vcs/crawler-book-outline ]\n    $ firefox index.html\n    ```\n\n    ![ansiblebook](https://cloud.githubusercontent.com/assets/219066/24584670/8ffb25f2-17a7-11e7-913a-2f570f773a66.png)\n\n1. We can see the \u003chttps://www.tenlong.com.tw/products/9781491915325\u003e\n    , it is clean, now.\n\n### Run local Nginx for Evernote Web Clipper\n\nThe **Evernote Web Clipper** is not support local files, so we can clip it with Nginx.\n\n1. Run Nginx container.\n\n    ``` shell\n    docker run --name nginx -v \"$(pwd)\":/usr/share/nginx/html/ -p 80:80 -d nginx\n    ```\n\n1. Open html via Firefox on GNU/Linux.\n\n    ``` shell\n    (py3) [ jonny@xenial ~/vcs/crawler-book-outline ]\n    $ firefox http://localhost\n    ```\n\n1. Finally, we can clip the information to Evernote with [Evernote Web Clipper](https://evernote.com/intl/zh-tw/webclipper/).\n\n## License\n\nCopyright (c) chusiang from 2017-2024 under the MIT license.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchusiang%2Fcrawler-book-info","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fchusiang%2Fcrawler-book-info","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchusiang%2Fcrawler-book-info/lists"}