https://github.com/cseas/crawler

Recursive web crawler
https://github.com/cseas/crawler

crawler python seed-webpage

Last synced: 13 days ago
JSON representation

Recursive web crawler

• Host: GitHub
• URL: https://github.com/cseas/crawler
• Owner: cseas
• License: mit
• Created: 2018-02-01T18:26:54.000Z (almost 7 years ago)
• Default Branch: master
• Last Pushed: 2018-06-19T19:19:54.000Z (over 6 years ago)
• Last Synced: 2024-11-07T05:46:30.239Z (2 months ago)
• Topics: crawler, python, seed-webpage
• Language: Python
• Size: 5.86 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# crawler

Web crawler to recursively extract all the links reachable from a seed webpage.

Instructions:

1. Run the script crawler.py using python3

2. Paste link of seed webpage

3. Hit Enter