https://github.com/rix4uni/pathcrawler
Discover new paths via scanning html.
https://github.com/rix4uni/pathcrawler
bug-bounty bugbounty bugbountytips crawler hacking infosec osint osint-resources osint-tool pathcrawler penetration-testing pentest-tool pentesting recon reconnaissance scrape security security-tools threat-intelligence
Last synced: 4 months ago
JSON representation
Discover new paths via scanning html.
- Host: GitHub
- URL: https://github.com/rix4uni/pathcrawler
- Owner: rix4uni
- Created: 2024-12-12T12:02:55.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-12-12T12:04:56.000Z (over 1 year ago)
- Last Synced: 2025-10-29T11:42:25.718Z (8 months ago)
- Topics: bug-bounty, bugbounty, bugbountytips, crawler, hacking, infosec, osint, osint-resources, osint-tool, pathcrawler, penetration-testing, pentest-tool, pentesting, recon, reconnaissance, scrape, security, security-tools, threat-intelligence
- Language: Go
- Size: 1.95 KB
- Stars: 1
- Watchers: 1
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## pathcrawler
Discover new paths via scanning html.
## Installation
```
go install github.com/rix4uni/pathcrawler@latest
```
## Download prebuilt binaries
```
wget https://github.com/rix4uni/pathcrawler/releases/download/v0.0.1/pathcrawler-linux-amd64-0.0.1.tgz
tar -xvzf pathcrawler-linux-amd64-0.0.1.tgz
rm -rf pathcrawler-linux-amd64-0.0.1.tgz
mv pathcrawler ~/go/bin/pathcrawler
```
Or download [binary release](https://github.com/rix4uni/pathcrawler/releases) for your platform.
## Compile from source
```
git clone --depth 1 github.com/rix4uni/pathcrawler.git
cd pathcrawler; go install
```
## Usage
```
Usage of pathcrawler:
-complete-url
Complete relative URLs based on the input URL
-concurrent int
Number of concurrent requests (default 50)
-delay duration
Delay between requests
-only-complete
Show only complete URLs starting with http:// or https://
-silent
silent mode.
-timeout duration
Timeout duration for HTTP requests (default 10s)
-version
Print the version of the tool and exit.
```
## Examples
Single Target:
```
▶ echo "https://dell.com" | pathcrawler -silent
```
Multiple Targets:
```
▶ cat targets.txt
https://google.com
https://dell.com
▶ cat targets.txt | pathcrawler -silent
```