https://github.com/v4iv/spider
Python based Website Crawler
https://github.com/v4iv/spider
Last synced: 23 days ago
JSON representation
Python based Website Crawler
- Host: GitHub
- URL: https://github.com/v4iv/spider
- Owner: v4iv
- Created: 2016-02-28T14:06:55.000Z (about 9 years ago)
- Default Branch: master
- Last Pushed: 2016-03-04T21:26:39.000Z (about 9 years ago)
- Last Synced: 2025-02-14T05:19:16.369Z (3 months ago)
- Language: Python
- Size: 14.6 KB
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Spider
Python based Website Crawler
Written Using Python Tools for Visual Studio 2015 Community
# Usage
python aragog.py -p [project name] -u [homepage url] -t [number of threads *optional, default = 8*]
**Example**
python aragog.py -p example_project -u https://example.com -t 10