https://github.com/eval-exec/goodreads

gocolly/colly demo project, crawl quotes from https://www.goodreads.com/quotes
https://github.com/eval-exec/goodreads

colly gocolly goodreads goodreads-quotes

Last synced: 3 months ago
JSON representation

gocolly/colly demo project, crawl quotes from https://www.goodreads.com/quotes

• Host: GitHub
• URL: https://github.com/eval-exec/goodreads
• Owner: eval-exec
• License: mit
• Created: 2019-08-16T15:23:22.000Z (almost 6 years ago)
• Default Branch: master
• Last Pushed: 2022-10-22T04:23:57.000Z (over 2 years ago)
• Last Synced: 2025-04-09T12:06:58.723Z (3 months ago)
• Topics: colly, gocolly, goodreads, goodreads-quotes
• Language: Go
• Homepage:
• Size: 29.3 KB
• Stars: 13
• Watchers: 1
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# goodreads crawler

[![Go Report Card](https://goreportcard.com/badge/github.com/eval-exec/goodreads?style=flat-square)](https://goreportcard.com/report/github.com/eval-exec/goodreads)

[![Coverage](https://codecov.io/gh/eval-exec/goodreads/branch/main/graph/badge.svg)](https://codecov.io/gh/eval-exec/goodreads)

[![codeql-analysis](https://github.com/eval-exec/goodreads/actions/workflows/codeql.yml/badge.svg)](https://github.com/eval-exec/goodreads/actions/workflows/codeql.yml)

[![LICENSE](https://img.shields.io/github/license/eval-exec/goodreads.svg?style=flat-square)](https://github.com/eval-exec/goodreads/blob/main/LICENSE)

[![Godoc](http://img.shields.io/badge/go-documentation-blue.svg?style=flat-square)](https://godoc.org/github.com/eval-exec/goodreads)

## About The Project

## usage:

- proxy-server: optional

- tag: optional, if empty, all tags will be visited

- debug: optional, enable debug mode?

```bash

> go build .

> ./goodreads -h

a simple goodread quote crawler

Usage:

  goodreads [flags]

Examples:

./goodreads --proxy-server http://127.0.0.1:1081 --tag hope --debug

Flags:

      --debug                 debug mode?

  -h, --help                  help for goodreads

      --proxy-server string   proxy server to use

      --tag string            optional: specify a tag to scrape?

```

```bash

> ./goodreads --proxy-server http://127.0.0.1:1081 --tag hope --debug

```

then check the `goodreads.csv` file