https://github.com/mustafadalga/website-crawler
Hedef web sitesini tarayarak linklerini listeleyen bir web crawler scripti || A web crawler script that lists links by scanning the target website.
https://github.com/mustafadalga/website-crawler
crawl crawler crawling-sites hacking hacking-tool web-crawler web-crawler-python web-crawling
Last synced: 3 months ago
JSON representation
Hedef web sitesini tarayarak linklerini listeleyen bir web crawler scripti || A web crawler script that lists links by scanning the target website.
- Host: GitHub
- URL: https://github.com/mustafadalga/website-crawler
- Owner: mustafadalga
- License: gpl-3.0
- Created: 2019-05-31T10:08:41.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2020-06-24T10:46:48.000Z (almost 5 years ago)
- Last Synced: 2025-01-18T08:31:58.898Z (5 months ago)
- Topics: crawl, crawler, crawling-sites, hacking, hacking-tool, web-crawler, web-crawler-python, web-crawling
- Language: Python
- Size: 19.5 KB
- Stars: 0
- Watchers: 1
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
```
__ __ _ _____ _
\ \ / / | | / ____| | |
\ \ /\ / /__| |__ | | _ __ __ ___ _| | ___ _ __
\ \/ \/ / _ \ '_ \ | | | '__/ _` \ \ /\ / / |/ _ \ '__|
\ /\ / __/ |_) | | |____| | | (_| |\ V V /| | __/ |
\/ \/ \___|_.__/ \_____|_| \__,_| \_/\_/ |_|\___|_|
```
#### Hedef web sitesini tarayarak linklerini listeleyen bir web crawler scripti || A web crawler script that lists links by scanning the target website.
#### Kurulacak modül
* Linux için kurulum
```
sudo pip install -r requirements.txt
```
* Windows için kurulum
```
python -m pip install -r .\requirements.txt
```
#### Kullanım
* Örnek Kullanım1
```
python spider.py --url http://10.0.2.6/mutillidae
```
* Örnek Kullanım2
```
python spider.py -u http://10.0.2.6/mutillidae
```
