Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/acidvegas/massrdap

A high-performance RDAP resolver for bulk lookups and reconnaissance
https://github.com/acidvegas/massrdap

masscan massdns rdap recon reconnaissance registrar whois

Last synced: 10 days ago
JSON representation

A high-performance RDAP resolver for bulk lookups and reconnaissance

Host: GitHub
URL: https://github.com/acidvegas/massrdap
Owner: acidvegas
License: isc
Created: 2024-03-20T02:12:57.000Z (11 months ago)
Default Branch: main
Last Pushed: 2024-03-20T05:23:29.000Z (11 months ago)
Last Synced: 2024-11-20T20:39:28.415Z (2 months ago)
Topics: masscan, massdns, rdap, recon, reconnaissance, registrar, whois
Language: Python
Homepage:
Size: 2.03 MB
Stars: 2
Watchers: 2
Forks: 0
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

        # MassRDAP

![](./preview.gif)

## Information

This script will take an input list of domains and retrieve [WHOIS](https://en.wikipedia.org/wiki/WHOIS) information for them using the [Registration Data Access Protocol](https://en.wikipedia.org/wiki/Registration_Data_Access_Protocol) *(RDAP)*. Depending on the TLD the domain is under will determine which RDAP server the request is made on. We are using the [Bootstrap Service Registry for Domain Name Space](https://www.iana.org/assignments/rdap-dns/rdap-dns.xhtml) from [IANA](https://www.iana.org/).

###### This is a work in progress still *(stay tuned)*

## Rate Limiting

From my experience, it seems every RDAP server has their employed rate limits. While I am still benchmarking and testing these limits, proxy support has been added to circumvent this issue.

## Usage

| Argument              | Description                                                           | Default Value |

|-----------------------|-----------------------------------------------------------------------|---------------|

| `-i`, `--input_file`  | File containing list of domains (one per line).                       |               |

| `-p`, `--proxy`       | Proxy in `user:pass@host:port` format. If not supplied, none is used. |               |

| `-c`, `--concurrency` | Number of concurrent requests to make.                                | 25            |

| `-o`, `--output`      | Output file to write successful RDAP data to.                         | `output.json` |

| `-f`, `--failed`      | Output file to write failed domains to. (optional)                    | `failed.txt`  |

## WHOIS & RDAP Statistics

By comparing the [root TLDS](https://data.iana.org/TLD/tlds-alpha-by-domain.txt) and the [RDAP Bootstrap](https://data.iana.org/rdap/dns.json) data from IANA, along with querying IANA's [WHOIS](https://www.iana.org/whois) server to find other TLD's WHOIS servers, we can formulate coverage statistics on WHOIS/RDAP availability across all available TLDS:

###### RDAP

| Status  | Results       |

| ------- | ------------- |

| RDAP    | 1,174 *(81%)* |

| No RDAP |   275 *(19%)* |

###### WHOIS

| Status   | Results       |

| -------- | ------------- |

| WHOIS    | 1,253 *(86%)* |

| No WHOIS |   196 *(14%)* |

## Roadmap

- Explore other RDAP servers from RIRs, registrars, IANA *(see [here](https://data.iana.org/rdap/))*

- Mass domain availability lookups

- Find available 1 or 2 letter domains.

___

###### Mirrors for this repository: [acid.vegas](https://git.acid.vegas/massrdap) • [SuperNETs](https://git.supernets.org/acidvegas/massrdap) • [GitHub](https://github.com/acidvegas/massrdap) • [GitLab](https://gitlab.com/acidvegas/massrdap) • [Codeberg](https://codeberg.org/acidvegas/massrdap)