https://github.com/abaykan/CrawlBox

Easy way to brute-force web directory.
https://github.com/abaykan/CrawlBox

admin-finder crawler python web-crawler wordlist

Last synced: 19 days ago
JSON representation

Easy way to brute-force web directory.

• Host: GitHub
• URL: https://github.com/abaykan/CrawlBox
• Owner: abaykan
• License: unlicense
• Archived: true
• Created: 2018-02-24T10:48:09.000Z (about 7 years ago)
• Default Branch: master
• Last Pushed: 2019-06-02T19:35:54.000Z (almost 6 years ago)
• Last Synced: 2025-03-19T22:50:51.762Z (26 days ago)
• Topics: admin-finder, crawler, python, web-crawler, wordlist
• Language: Python
• Size: 71.3 KB
• Stars: 148
• Watchers: 8
• Forks: 40
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-termux-hacking - CrawlBox - Easy way to brute-force web directory..[](https://github.com/abaykan/CrawlBox/stargazers/) (Uncategorized / Uncategorized)

README

        
# CrawlBox | 

[![Awesome](https://awesome.re/badge.svg)](https://awesome.re)

[![GitHub forks](https://img.shields.io/github/forks/abaykan/CrawlBox.svg)](https://github.com/abaykan/CrawlBox/network)

[![GitHub stars](https://img.shields.io/github/stars/abaykan/CrawlBox.svg)](https://github.com/abaykan/CrawlBox/stargazers)

[![HitCount](http://hits.dwyl.io/abaykan/crawlbox.svg)](http://hits.dwyl.io/abaykan/crawlbox)

[![GitHub license](https://img.shields.io/github/license/abaykan/CrawlBox.svg)](https://github.com/abaykan/CrawlBox/blob/master/LICENSE)

[![TypeScript](https://badges.frapsoft.com/typescript/love/typescript.png?v=101)](https://github.com/ellerbrock/typescript-badges/)




[![Open Source Love](https://badges.frapsoft.com/os/v1/open-source.svg?v=103)](https://github.com/ellerbrock/open-source-badges/)

[![bitHound](https://img.shields.io/bithound/code/github/rexxars/sse-channel.svg)](https://github.com/abaykan/CrawlBox/)

[![PyPI - Python Version](https://img.shields.io/pypi/pyversions/Django.svg?style=plastic)](https://github.com/abaykan/CrawlBox/)

[![Build Status](https://semaphoreci.com/api/v1/abaykan/crawlbox-2/branches/add-license-1/shields_badge.svg)](https://semaphoreci.com/abaykan/crawlbox-2)

Easy way to brute-force web directory.







# Operating Systems Tested

- MacOSX

- Kali Linux

- Ubuntu 16.04

# Usage

python crawlbox.py [-h] [-v] [-w WORDLIST] url

positional arguments:


  
url            specific target url, like domain.com

optional arguments:


  -h, --help     show this help message and exit

  -v, --version  show program's version number and exit

  -w WORDLIST    specific path to wordlist file

  -d DELAY       add delay between requests


# Example

web site scan with internal wordlist

python crawlbox.py www.domain.com

web site scan with external wordlist


python crawlbox.py www.domain.com -w wordlist.txt


# Install

(as root)

  

  git clone https://github.com/abaykan/crawlbox.git

  cd crawlbox/

  pip install -r requirements.txt

  python crawlbox.py -h

  

note: tested with python 2.7.6


# Media Review

- Seucurity Training Share : https://securityonline.info/crawlbox-brute-force-web-directory/

- PentestTools : https://pentesttoolz.com/2018/03/02/crawlbox-easy-way-to-brute-force-web-directory/

- Hacking Reviews : https://www.hacking.reviews/2018/03/crawlbox-easy-way-to-brute-force-web.html

- KitPloit : https://www.kitploit.com/2018/03/crawlbox-easy-way-to-brute-force-web.html

- Haxf4rall : http://haxf4rall.com/2018/03/08/crawlbox-easy-way-to-brute-force-web-directory/

- The Hack Today : https://thehacktoday.com/crawlbox-easy-way-brute-force-web-directory/

- SAPSI Security Service http://sapsi.org/crawlbox-easy-way-to-brute-force-web-directory/