Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/mustafadalga/website-crawler
Hedef web sitesini tarayarak linklerini listeleyen bir web crawler scripti || A web crawler script that lists links by scanning the target website.
https://github.com/mustafadalga/website-crawler
crawl crawler crawling-sites hacking hacking-tool web-crawler web-crawler-python web-crawling
Last synced: 24 days ago
JSON representation
Hedef web sitesini tarayarak linklerini listeleyen bir web crawler scripti || A web crawler script that lists links by scanning the target website.
- Host: GitHub
- URL: https://github.com/mustafadalga/website-crawler
- Owner: mustafadalga
- License: gpl-3.0
- Created: 2019-05-31T10:08:41.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2020-06-24T10:46:48.000Z (over 4 years ago)
- Last Synced: 2024-11-17T13:20:57.551Z (3 months ago)
- Topics: crawl, crawler, crawling-sites, hacking, hacking-tool, web-crawler, web-crawler-python, web-crawling
- Language: Python
- Size: 19.5 KB
- Stars: 0
- Watchers: 1
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
```
__ __ _ _____ _
\ \ / / | | / ____| | |
\ \ /\ / /__| |__ | | _ __ __ ___ _| | ___ _ __
\ \/ \/ / _ \ '_ \ | | | '__/ _` \ \ /\ / / |/ _ \ '__|
\ /\ / __/ |_) | | |____| | | (_| |\ V V /| | __/ |
\/ \/ \___|_.__/ \_____|_| \__,_| \_/\_/ |_|\___|_|
```
#### Hedef web sitesini tarayarak linklerini listeleyen bir web crawler scripti || A web crawler script that lists links by scanning the target website.
#### Kurulacak modül
* Linux için kurulum
```
sudo pip install -r requirements.txt
```
* Windows için kurulum
```
python -m pip install -r .\requirements.txt
```
#### Kullanım
* Örnek Kullanım1
```
python spider.py --url http://10.0.2.6/mutillidae
```
* Örnek Kullanım2
```
python spider.py -u http://10.0.2.6/mutillidae
```
