https://github.com/crackcomm/go-google-search

Google search NSQ worker
https://github.com/crackcomm/go-google-search

crawler google google-search search

Last synced: 4 months ago
JSON representation

Google search NSQ worker

• Host: GitHub
• URL: https://github.com/crackcomm/go-google-search
• Owner: crackcomm
• License: apache-2.0
• Created: 2017-03-18T16:41:31.000Z (about 9 years ago)
• Default Branch: master
• Last Pushed: 2017-03-24T22:52:59.000Z (about 9 years ago)
• Last Synced: 2024-06-20T03:35:24.016Z (almost 2 years ago)
• Topics: crawler, google, google-search, search
• Language: Go
• Size: 8.79 KB
• Stars: 3
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# go-google-search

[![Circle CI](https://img.shields.io/circleci/project/crackcomm/go-google-search.svg)](https://circleci.com/gh/crackcomm/go-google-search)

Google search crawler with NSQ worker.

## Usage

Example usage from command line:

```sh

# Install command line application for crawl scheduling

$ go install github.com/crackcomm/crawl/nsq/crawl-schedule

# Schedule crawl of google search results

$ crawl-schedule \

      --nsq-topic google_search \

      --callback github.com/crackcomm/go-google-search/spider.Google \

      "https://www.google.com/search?q=Github"

```

## License

                                 Apache License

                           Version 2.0, January 2004

                        http://www.apache.org/licenses/

## Authors

* [Łukasz Kurowski](https://github.com/crackcomm)