https://github.com/hueristiq/xurlfind3r
A command-line utility designed to discover URLs for a given domain in a simple, efficient way. It works by gathering information from a variety of passive sources, meaning it doesn't interact directly with the target but instead gathers data that is already publicly available.
https://github.com/hueristiq/xurlfind3r
bug-bounty bug-bounty-tools contentdiscovery ethical-hacking ethical-hacking-tools go golang osint osint-tools penetration-testing penetration-testing-tools reconnaissance red-teaming red-teaming-tools web-security
Last synced: about 1 month ago
JSON representation
A command-line utility designed to discover URLs for a given domain in a simple, efficient way. It works by gathering information from a variety of passive sources, meaning it doesn't interact directly with the target but instead gathers data that is already publicly available.
- Host: GitHub
- URL: https://github.com/hueristiq/xurlfind3r
- Owner: hueristiq
- License: mit
- Created: 2021-05-13T07:12:20.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2025-07-27T11:47:21.000Z (4 months ago)
- Last Synced: 2025-07-27T13:23:47.189Z (4 months ago)
- Topics: bug-bounty, bug-bounty-tools, contentdiscovery, ethical-hacking, ethical-hacking-tools, go, golang, osint, osint-tools, penetration-testing, penetration-testing-tools, reconnaissance, red-teaming, red-teaming-tools, web-security
- Language: Go
- Homepage: https://github.com/hueristiq/xurlfind3r
- Size: 434 KB
- Stars: 622
- Watchers: 8
- Forks: 71
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
- Offensive-OSINT-Tools - Xurlfind3r
- awesome-hacking-lists - hueristiq/xurlfind3r - A command-line utility designed to discover URLs for a given domain in a simple, efficient way. It works by gathering information from a variety of passive sources, meaning it doesn't interact directl (Go)
- osint_stuff_tool_collection - XURLFIND3R
README
# xurlfind3r
 [](https://goreportcard.com/report/github.com/hueristiq/xurlfind3r) [](https://github.com/hueristiq/xurlfind3r/releases) [](https://github.com/hueristiq/xurlfind3r/issues?q=is:issue+is:open) [](https://github.com/hueristiq/xurlfind3r/issues?q=is:issue+is:closed) [](https://github.com/hueristiq/xurlfind3r/blob/master/LICENSE)  [](https://github.com/hueristiq/xurlfind3r/blob/master/CONTRIBUTING.md)
`xurlfind3r` is a command-line utility designed to discover URLs for a given domain in a simple, efficient way. It works by gathering information from a variety of passive sources, meaning it doesn't interact directly with the target but instead gathers data that is already publicly available. This makes `xurlfind3r` a powerful tool for security researchers, IT professionals, and anyone looking to gain insights into the URLs associated with a domain.
## Resource
- [Features](#features)
- [Installation](#installation)
- [Install release binaries (Without Go Installed)](#install-release-binaries-without-go-installed)
- [Install source (With Go Installed)](#install-source-with-go-installed)
- [`go install ...`](#go-install)
- [`go build ...` the development version](#go-build--the-development-version)
- [Install on Docker (With Docker Installed)](#install-on-docker-with-docker-installed)
- [Post Installation](#post-installation)
- [Usage](#usage)
- [Contributing](#contributing)
- [Licensing](#licensing)
## Features
- Fetches URLs from multiple online passive sources to provide extensive results
- Supports `stdin` and `stdout` for easy integration in automated workflows
- Supports multiple output formats (JSONL, file, stdout)
- Cross-Platform (Windows, Linux, and macOS)
## Installation
### Install release binaries (Without Go Installed)
Visit the [releases page](https://github.com/hueristiq/xurlfind3r/releases) and find the appropriate archive for your operating system and architecture. Download the archive from your browser or copy its URL and retrieve it with `wget` or `curl`:
- ...with `wget`:
```bash
wget https://github.com/hueristiq/xurlfind3r/releases/download/v/xurlfind3r--linux-amd64.tar.gz
```
- ...or, with `curl`:
```bash
curl -OL https://github.com/hueristiq/xurlfind3r/releases/download/v/xurlfind3r--linux-amd64.tar.gz
```
...then, extract the binary:
```bash
tar xf xurlfind3r--linux-amd64.tar.gz
```
> [!TIP]
> The above steps, download and extract, can be combined into a single step with this onliner
>
> ```bash
> curl -sL https://github.com/hueristiq/xurlfind3r/releases/download/v/xurlfind3r--linux-amd64.tar.gz | tar -xzv
> ```
> [!NOTE]
> On Windows systems, you should be able to double-click the zip archive to extract the `xurlfind3r` executable.
...move the `xurlfind3r` binary to somewhere in your `PATH`. For example, on GNU/Linux and OS X systems:
```bash
sudo mv xurlfind3r /usr/local/bin/
```
> [!NOTE]
> Windows users can follow [How to: Add Tool Locations to the PATH Environment Variable](https://msdn.microsoft.com/en-us/library/office/ee537574(v=office.14).aspx) in order to add `xurlfind3r` to their `PATH`.
### Install source (With Go Installed)
Before you install from source, you need to make sure that Go is installed on your system. You can install Go by following the official instructions for your operating system. For this, we will assume that Go is already installed.
#### `go install ...`
```bash
go install -v github.com/hueristiq/xurlfind3r/cmd/xurlfind3r@latest
```
#### `go build ...` the development version
- Clone the repository
```bash
git clone https://github.com/hueristiq/xurlfind3r.git
```
- Build the utility
```bash
cd xurlfind3r/cmd/xurlfind3r && \
go build .
```
- Move the `xurlfind3r` binary to somewhere in your `PATH`. For example, on GNU/Linux and OS X systems:
```bash
sudo mv xurlfind3r /usr/local/bin/
```
Windows users can follow [How to: Add Tool Locations to the PATH Environment Variable](https://msdn.microsoft.com/en-us/library/office/ee537574(v=office.14).aspx) in order to add `xurlfind3r` to their `PATH`.
> [!CAUTION]
> While the development version is a good way to take a peek at `xurlfind3r`'s latest features before they get released, be aware that it may have bugs. Officially released versions will generally be more stable.
### Install on Docker (With Docker Installed)
To install `xurlfind3r` on docker:
- Pull the docker image using:
```bash
docker pull hueristiq/xurlfind3r:latest
```
- Run `xurlfind3r` using the image:
```bash
docker run --rm hueristiq/xurlfind3r:latest -h
```
## Post Installation
`xurlfind3r` will work right after [installation](#installation). However, some sources require API keys to work. These keys can be added to a configuration file at `$HOME/.config/xurlfind3r/config.yaml`, created upon first run, or set as environment variables.
Example of environment variables for API keys:
```bash
XURLFIND3R_KEYS_BEVIGIL=your_bevigil_key
XURLFIND3R_KEYS_ONTELX=your_intelx_key
```
## Usage
To start using `xurlfind3r`, open your terminal and run the following command for a list of options:
```bash
xurlfind3r -h
```
Here's what the help message looks like:
```
_ __ _ _ _____
__ ___ _ _ __| |/ _(_)_ __ __| |___ / _ __
\ \/ / | | | '__| | |_| | '_ \ / _` | |_ \| '__|
> <| |_| | | | | _| | | | | (_| |___) | |
/_/\_\\__,_|_| |_|_| |_|_| |_|\__,_|____/|_|
v1.2.0
USAGE:
xurlfind3r [OPTIONS]
CONFIGURATION:
-c, --configuration string (default: $HOME/.config/xurlfind3r/config.yaml)
INPUT:
-d, --domain string[] target domain
-l, --list string target domains file path
For multiple domains, use comma(,) separated value with `--domain`,
specify multiple `--domains`, load from file with `--list` or load from stdin.
SCOPE:
--include-subdomains bool match subdomain's URLs
SOURCES:
--sources bool list supported sources
-u, --sources-to-use string[] comma(,) separated sources to use
-e, --sources-to-exclude string[] comma(,) separated sources to exclude
OUTPUT:
--jsonl bool output in JSONL(ines)
-o, --output string output write file path
-O, --output-directory string output write directory path
-m, --monochrome bool stdout in monochrome
-s, --silent bool stdout in silent mode
-v, --verbose bool stdout in verbose mode
```
## Contributing
Contributions are welcome and encouraged! Feel free to submit [Pull Requests](https://github.com/hueristiq/xurlfind3r/pulls) or report [Issues](https://github.com/hueristiq/xurlfind3r/issues). For more details, check out the [contribution guidelines](https://github.com/hueristiq/xurlfind3r/blob/master/CONTRIBUTING.md).
A big thank you to all the [contributors](https://github.com/hueristiq/xurlfind3r/graphs/contributors) for your ongoing support!
## Licensing
This package is licensed under the [MIT license](https://opensource.org/license/mit). You are free to use, modify, and distribute it, as long as you follow the terms of the license. You can find the full license text in the repository - [Full MIT license text](https://github.com/hueristiq/xurlfind3r/blob/master/LICENSE).