https://github.com/marirs/bigdomaindata-whois-rs
Convert bigdomain data whois from CSV to Mongo
https://github.com/marirs/bigdomaindata-whois-rs
big-domain-data bigdomaindata csv historical-whois mongodb rust whois whois-client
Last synced: 2 months ago
JSON representation
Convert bigdomain data whois from CSV to Mongo
- Host: GitHub
- URL: https://github.com/marirs/bigdomaindata-whois-rs
- Owner: marirs
- License: mit
- Created: 2024-04-03T04:14:14.000Z (over 1 year ago)
- Default Branch: master
- Last Pushed: 2024-05-15T05:24:54.000Z (over 1 year ago)
- Last Synced: 2025-01-02T08:29:28.652Z (9 months ago)
- Topics: big-domain-data, bigdomaindata, csv, historical-whois, mongodb, rust, whois, whois-client
- Language: Rust
- Homepage:
- Size: 51.8 KB
- Stars: 0
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Convert bigdomain data whois from CSV to Mongo
Converts [BigDomain](https://www.bigdomaindata.com/) data from CSV to Mongo.
### Requirements
- [Rust](https://www.rust-lang.org/tools/install) - If you want to compile from source.
- [MongoDB](https://www.mongodb.com/try/download/community)
- [BigDomain](https://www.bigdomaindata.com/) data in CSV format [Samples Download](https://www.bigdomaindata.com/free-whois-database/)
### Help
```bash
$ ./target/debug/whois --help
Usage: whois [OPTIONS]
Options:
-f, --csv-files-path The path to the CSV files [default: ./data]
-h, --mongo-host MongoDB host [default: localhost]
-p, --mongo-port MongoDB port [default: 27017]
-d, --mongo-db MongoDB database [default: whois]
-c, --mongo-collection MongoDB collection [default: feeds]
-t, --threads Number of threads to use [default: 512]
--mongo-user MongoDB User [default: ]
--mongo-password MongoDB Password [default: ]
--debug Enable debug mode
--help
-V, --version Print version
```
### Usage
- Using default settings
```bash
./whois
```
- Using custom settings
```bash
./whois --csv-files-path /path/to/csv/files --mongo-host 10.10.10.10 --mongo-port 27017 --mongo-db whois --mongo-collection feeds
```
---
License: MIT