https://github.com/igor-karpukhin/web-crawler

Web site crawler
https://github.com/igor-karpukhin/web-crawler

crawler go website

Last synced: 17 days ago
JSON representation

Web site crawler

• Host: GitHub
• URL: https://github.com/igor-karpukhin/web-crawler
• Owner: igor-karpukhin
• License: gpl-3.0
• Created: 2018-02-18T09:15:55.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2018-03-06T09:43:56.000Z (over 6 years ago)
• Last Synced: 2024-10-02T15:41:35.147Z (about 1 month ago)
• Topics: crawler, go, website
• Language: Go
• Size: 2.88 MB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# web-crawler

### Description

Tool to get web-site links tree

### Build

***MacOS***: `make get && make build_osx && make coverage`

***Linux***: `make all`