https://github.com/dimo414/pycrawl

Simple Python web crawler, primarily designed for inspecting and diagnosing your own website
https://github.com/dimo414/pycrawl

crawler python

Last synced: 26 days ago
JSON representation

Simple Python web crawler, primarily designed for inspecting and diagnosing your own website

• Host: GitHub
• URL: https://github.com/dimo414/pycrawl
• Owner: dimo414
• License: gpl-3.0
• Created: 2020-01-17T07:59:51.000Z (almost 5 years ago)
• Default Branch: master
• Last Pushed: 2020-01-17T08:00:24.000Z (almost 5 years ago)
• Last Synced: 2023-04-25T22:43:09.920Z (over 1 year ago)
• Topics: crawler, python
• Language: Python
• Homepage:
• Size: 39.1 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 7

Awesome Lists containing this project