https://github.com/igor-karpukhin/web-crawler

Web site crawler
https://github.com/igor-karpukhin/web-crawler

crawler go website

Last synced: about 1 year ago
JSON representation

Web site crawler

• Host: GitHub
• URL: https://github.com/igor-karpukhin/web-crawler
• Owner: igor-karpukhin
• License: gpl-3.0
• Created: 2018-02-18T09:15:55.000Z (over 8 years ago)
• Default Branch: master
• Last Pushed: 2018-03-06T09:43:56.000Z (over 8 years ago)
• Last Synced: 2025-02-03T13:46:53.400Z (over 1 year ago)
• Topics: crawler, go, website
• Language: Go
• Size: 2.88 MB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# web-crawler

### Description

Tool to get web-site links tree

### Build

***MacOS***: `make get && make build_osx && make coverage`

***Linux***: `make all`