Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/1uc1f3r616/dark-net-websites-dataset
Dataset of Onion Websites
https://github.com/1uc1f3r616/dark-net-websites-dataset
crawler darknet data-analysis dataset onion search-engine website
Last synced: 17 days ago
JSON representation
Dataset of Onion Websites
- Host: GitHub
- URL: https://github.com/1uc1f3r616/dark-net-websites-dataset
- Owner: 1UC1F3R616
- Created: 2020-07-10T14:42:09.000Z (over 4 years ago)
- Default Branch: master
- Last Pushed: 2020-07-11T03:04:00.000Z (over 4 years ago)
- Last Synced: 2024-11-11T17:49:40.787Z (3 months ago)
- Topics: crawler, darknet, data-analysis, dataset, onion, search-engine, website
- Homepage: https://1uc1f3r616.github.io/Dark-Net-Websites-Dataset/
- Size: 11.6 MB
- Stars: 4
- Watchers: 3
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Dark Net Websites Dataset
This repository contains scraped websites from DarkNet that were active at that time
Update Frequency: Monthly
Note: Next datasets will not be keyworded instead code for making them clean will be provided, so to make the dataset more customizable
Use-Cases: Data-Analysis, Onion-site-Dataset, Search-Engine, Elastic-Search
Crawler used is [this](https://github.com/1UC1F3R616/onion-crawler)
Issues and Suggestions are welcome!
Missing your website? ==> Create an issue for addition of your requested website
---------------------------------------------
## JULY 2020
- Format: `CSV`
- Size: `71.4 MB`
- Website Count: `10430`
- Download
```bash
wget https://raw.githubusercontent.com/1UC1F3R616/Dark-Net-Websites-Dataset/raw/master/scraped_data_DRL_2020-07-10T06-02-31.csv
```## JUNE 2020
- Format: `JSON`
- Size: `7 MB`
- Website Count: `1350`
- Download
```bash
wget https://raw.githubusercontent.com/1UC1F3R616/Dark-Net-Websites-Dataset/master/scraped_data_DRL_2020-07-02T00-58-53.json
```