Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/bunseokbot/darklight
Engine for collecting onion domains and crawling from webpage based on Tor network
https://github.com/bunseokbot/darklight
celery crawler crawling darkweb engine python redis tor
Last synced: 25 days ago
JSON representation
Engine for collecting onion domains and crawling from webpage based on Tor network
- Host: GitHub
- URL: https://github.com/bunseokbot/darklight
- Owner: bunseokbot
- License: apache-2.0
- Created: 2018-12-16T12:49:33.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2022-12-08T01:44:02.000Z (about 2 years ago)
- Last Synced: 2024-08-03T17:12:11.594Z (4 months ago)
- Topics: celery, crawler, crawling, darkweb, engine, python, redis, tor
- Language: Python
- Homepage: https://darklight.kr
- Size: 16.1 MB
- Stars: 9
- Watchers: 2
- Forks: 4
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-network-stuff - **24**星
README
# DarkLight Core Engine
Core Engine for collecting onion domains and crawling from webpage based on Tor network## Main Features
* Crawling and capturing screenshot.
* Scanning well-known ports at target domain.
* Collecting artifacts from suspicious websites.
* Customize collector and pipeline if you want.## Developer
* Namjun Kim ([@bunseokbot](https://github.com/bunseokbot))