https://github.com/noarche/crawler

Url crawler spider
https://github.com/noarche/crawler

crawl crawler-python noisy python-script python3 spider

Last synced: 3 months ago
JSON representation

Url crawler spider

• Host: GitHub
• URL: https://github.com/noarche/crawler
• Owner: noarche
• License: gpl-3.0
• Created: 2024-08-14T02:33:13.000Z (10 months ago)
• Default Branch: main
• Last Pushed: 2025-01-04T20:15:18.000Z (6 months ago)
• Last Synced: 2025-01-30T08:16:01.920Z (5 months ago)
• Topics: crawl, crawler-python, noisy, python-script, python3, spider
• Language: Python
• Homepage:
• Size: 25 MB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
![seekr2](https://github.com/user-attachments/assets/33efc3f5-0bec-4931-944e-e63734dfdcb8)

![seekr3](https://github.com/user-attachments/assets/a085d498-9033-41f7-9631-be815c425118)

# URL Crawler

 Simple solid Url crawler spider

## Docker 

`docker pull torquetraction/crawler:latest`

`docker run -it torquetraction/crawler`