https://github.com/vindecodex/automated-crawler-wget

Using wget to crawl site
https://github.com/vindecodex/automated-crawler-wget

crawler shell-script

Last synced: 4 days ago
JSON representation

Using wget to crawl site

• Host: GitHub
• URL: https://github.com/vindecodex/automated-crawler-wget
• Owner: vindecodex
• License: mit
• Created: 2019-12-04T09:02:59.000Z (almost 5 years ago)
• Default Branch: master
• Last Pushed: 2020-08-12T02:29:54.000Z (over 4 years ago)
• Last Synced: 2023-03-10T14:19:58.518Z (over 1 year ago)
• Topics: crawler, shell-script
• Language: Shell
• Homepage:
• Size: 4.88 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0

Awesome Lists containing this project