https://github.com/shaishavgandhi/crawler

https://github.com/shaishavgandhi/crawler

Last synced: 7 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/shaishavgandhi/crawler
• Owner: ShaishavGandhi
• Created: 2018-03-14T08:13:39.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2018-03-14T08:15:20.000Z (over 7 years ago)
• Last Synced: 2025-01-30T06:41:32.378Z (8 months ago)
• Language: Python
• Size: 2.09 MB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Crawler

Simple Python Infinite Crawler. Give a root URL like so:

```python crawler.py "url_here"```