https://github.com/william-versatile/website-crawler

https://github.com/william-versatile/website-crawler

Last synced: about 1 year ago
JSON representation

• Host: GitHub
• URL: https://github.com/william-versatile/website-crawler
• Owner: William-versatile
• Created: 2024-02-18T19:53:47.000Z (over 2 years ago)
• Default Branch: master
• Last Pushed: 2024-02-18T19:54:31.000Z (over 2 years ago)
• Last Synced: 2025-02-10T15:17:04.554Z (over 1 year ago)
• Language: Python
• Size: 127 KB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# website-crawler

Website Crawling using Python

Be aware of File Path..

Ignore main.py file thats is just for reference

you can find sample text files in websites where some links are crawled