https://github.com/j1nx5/python_crawler

A simple crawler that shows all URLs of a domain.
https://github.com/j1nx5/python_crawler

python scrapy

Last synced: about 1 month ago
JSON representation

A simple crawler that shows all URLs of a domain.

• Host: GitHub
• URL: https://github.com/j1nx5/python_crawler
• Owner: J1NX5
• Created: 2024-01-17T21:16:14.000Z (12 months ago)
• Default Branch: main
• Last Pushed: 2024-06-13T15:11:31.000Z (7 months ago)
• Last Synced: 2024-06-13T18:02:01.171Z (7 months ago)
• Topics: python, scrapy
• Language: Python
• Homepage:
• Size: 13 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project