An open API service indexing awesome lists of open source software.

https://github.com/97k/pythonwebcrawler

A web crawler built using python. (WIP)
https://github.com/97k/pythonwebcrawler

Last synced: over 1 year ago
JSON representation

A web crawler built using python. (WIP)

Awesome Lists containing this project

README

          

# PythonWebCrawler
Just clone/download the project and run main.py to crawl the website for that particular domain