Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/0x4f53/subs
Grab valid subdomains, resolve them, split them and more!
https://github.com/0x4f53/subs
attack-surface-management cybersecurity cybersecurity-tool cybersecurity-tools golang hacking hacking-tool infosec linux macos network-analysis osint pentesting recon reconnaissance subdomain-enumeration subdomain-finder-in-go sudomains tools utilities
Last synced: 15 days ago
JSON representation
Grab valid subdomains, resolve them, split them and more!
- Host: GitHub
- URL: https://github.com/0x4f53/subs
- Owner: 0x4f53
- License: gpl-3.0
- Created: 2024-08-05T21:00:33.000Z (3 months ago)
- Default Branch: master
- Last Pushed: 2024-08-29T20:51:32.000Z (3 months ago)
- Last Synced: 2024-08-29T23:09:11.124Z (3 months ago)
- Topics: attack-surface-management, cybersecurity, cybersecurity-tool, cybersecurity-tools, golang, hacking, hacking-tool, infosec, linux, macos, network-analysis, osint, pentesting, recon, reconnaissance, subdomain-enumeration, subdomain-finder-in-go, sudomains, tools, utilities
- Language: Go
- Homepage:
- Size: 136 MB
- Stars: 3
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
- License: LICENSE
Awesome Lists containing this project
README
[](https://go.dev)
[](LICENSE)
[](https://github.com/0x4f53/subs/releases)
[](.build/binaries/)
# 🔍 subs
A utility to grab valid domains and subdomains from files, split them if they're fused, resolve them and more - straight from the command-line!
This is a command-line utility written in Golang as a proof-of-concept for the [textsubs package](https://github.com/0x4f53/textsubs).
Note: This tool only extracts subs from text. It does not extract URLs (there are several methods to do that, such as grep and regular
expressions)
Features:
- Splits fused strings (`google.comapple.comblog.0x4f.in` magically becomes `google.com` `apple.com` `blog.0x4f.in`)
- Resolves subdomains and domains concurrently in seconds
- Multiple kinds of output, including domain, subdomain or both as JSON!
## ⚙️ Building
To build this on your machine, you need to have Golang installed.
If you do, simply make build.sh executable and run it like so
```bash
chmod +x build.sh
./build.sh
```
### ⚙️ Installation
##### Linux and macOS
Simply run the `./install.sh` script (don't
have the time to put this on package managers)
```bash
chmod +x install.sh
sudo ./install.sh
```
And to uninstall
```bash
chmod +x uninstall.sh
sudo ./uninstall.sh
```
You can also find the binaries in [`.build/binaries`](.build/binaries/) if you want to directly run them
without installation
### 🖊️ Usage
```bash
subs [input_file] [flags]
```
#### Flags
- `-h`, `--help` Help
- `-d`, `--domains` Get domains only
- `-r`, `--resolve` Only get items that resolve (using local DNS settings)
- `-p`, `--pair` Pair as a JSON string `{"subdomain":"www.example.com", "domain": "example.com"}`
- `-k`, `--keepDomains` Keep both domains and subdomains in output (this catches both `example.com` and `www.example.com`)
- `-r`, `--resolve` Only get items that resolve (using local DNS settings)
#### Examples
Read a file on disk
```bash
❯ subs test.txt
subdomain1.example.com
subdomain2.example.com
subdomain3.example.com
subdomain4.example.com
...
```
Read all files in a directory
```bash
❯ for file in *; subs "$file"
www.gnu.org
google.golang.org
subdomain1.example.com
...
```
Generate permutations from a wordlist, resolve them and remove duplicates on the way.
```bash
❯ wget "https://wordlists-cdn.assetnote.io/data/manual/best-dns-wordlist.txt" -O
best-dns-wordlist.txt 100% [===================================>] 76.65M 2.28MB/s eta 24s
❯ awk '{print}' best-dns-wordlist.txt | xargs -n1 | while read line; do echo $line; done | xargs -n1 -I{} bash -c 'for i in $(cat best-dns-wordlist.txt); do for j in $(cat best-dns-wordlist.txt); do if [ "$i" != "$j" ]; then echo "$i.$j"; fi; done; done' >> permutations.txt
# This takes a long, long time.
❯ subs permutations.txt -r -p >> output.txt
# This takes even more time.
{"subdomain":"www.ci.dev","domain":"ci.dev"}
{"subdomain":"www.api.app","domain":"api.app"}
{"subdomain":"www.www.furniture","domain":"www.furniture"}
{"subdomain":"www.web.dev","domain":"web.dev"}
{"subdomain":"www.jira.dev","domain":"jira.dev"}
...
```
Continuously scan certificates on crt.sh for alive subdomains with autoincremented id
```bash
❯ id=129341; while true; do wget "https://crt.sh/?q=$id" -O .temp && subs .temp -r -p >> output.txt && rm .temp; id=$((id + 1)); done
{"subdomain":"crt.sh","domain":"crt.sh"}
{"subdomain":"fonts.googleapis.com","domain":"googleapis.com"}
{"subdomain":"ct.googleapis.com","domain":"googleapis.com"}
{"subdomain":"plausible.ct.nordu.net","domain":"nordu.net"}
```
---
Copyright (c) 2024 Owais Shaikh
Licensed under [GNU GPL 3.0](LICENSE)