Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/ameenmaali/wordlistgen
Quickly generate context-specific wordlists for content discovery from lists of URLs or paths
https://github.com/ameenmaali/wordlistgen
bugbounty content-discovery hacking infosec wordlists
Last synced: 22 days ago
JSON representation
Quickly generate context-specific wordlists for content discovery from lists of URLs or paths
- Host: GitHub
- URL: https://github.com/ameenmaali/wordlistgen
- Owner: ameenmaali
- Created: 2020-01-31T21:47:40.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2022-05-04T08:10:48.000Z (over 2 years ago)
- Last Synced: 2024-08-05T17:25:15.908Z (4 months ago)
- Topics: bugbounty, content-discovery, hacking, infosec, wordlists
- Language: Go
- Size: 4.88 KB
- Stars: 211
- Watchers: 6
- Forks: 41
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-hacking-lists - ameenmaali/wordlistgen - Quickly generate context-specific wordlists for content discovery from lists of URLs or paths (Go)
README
# wordlistgen
## What and why?
wordlistgen is a tool to pass a list of URLs and get back a list of relevant words for your wordlists. Wordlists are much more
effective when you take the application's context into consideration. wordlistgen pulls out URL components, such as subdomain names,
paths, query strings, etc. and spits them back to stdout so you can easily add them to your wordlists# Installation
If you don't have Go installed, "go" do that!```go get -u github.com/ameenmaali/wordlistgen```
## Usage
wordlistgen takes URLs and paths from stdin, of which you will most likely want in a file such as:
```
$ cat file.txt
https://google.com/home/?q=2&d=asd
http://my.site
/api/v2/auth/me?id=123
```Get unique URL components from a file of URLs and/or paths:
`cat hosts.txt | wordlistgen`
Get unique URL components from a file of URLs and/or paths, including query string values, and save to a file:
`cat hosts.txt | wordlistgen -qv > urlComponents.txt`
wordlistgen works at it's best when chained with other tools, such as [@tonnomnom's](https://github.com/tomnomnom) [waybackurls](https://github.com/tomnomnom/waybackurls) :
`cat hosts.txt | waybackurls | wordlistgen`
### Help
```
$ wordlistgen -h
Usage of wordlistgen:
-fq
If enabled, filter out query strings (e.g. if enabled /?q=123 - q would NOT be included in results
-qv
If enabled, include query string values (e.g. if enabled /?q=123 - 123 would be included in results
```