An open API service indexing awesome lists of open source software.

https://github.com/lascc/directory-crawler

Directory crawler with wordlist using python
https://github.com/lascc/directory-crawler

Last synced: 9 months ago
JSON representation

Directory crawler with wordlist using python

Awesome Lists containing this project

README

          

# Directory crawler
Directory crawler with wordlist using python

# Tech part

This script uses a number of open source projects to work properly:

- requests
- argparse
- re
- urlparse
- python

### Usage

```
usage: main.py [-h] [-u URL]

optional arguments:
-h, --help show this help message and exit
-u URL, --url URL Url that you want to crawl
```

```
python main.py -u [URL OF YOUR OWN WEBSITE]
```

### Pictures

[![N|Solid](https://i.imgur.com/fhNVyaI.png)](https://i.imgur.com/fhNVyaI.png)

@LasCC