https://github.com/bunseokbot/darklight

Engine for collecting onion domains and crawling from webpage based on Tor network
https://github.com/bunseokbot/darklight

celery crawler crawling darkweb engine python redis tor

Last synced: about 1 year ago
JSON representation

Engine for collecting onion domains and crawling from webpage based on Tor network

• Host: GitHub
• URL: https://github.com/bunseokbot/darklight
• Owner: bunseokbot
• License: apache-2.0
• Created: 2018-12-16T12:49:33.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2022-12-08T01:44:02.000Z (over 3 years ago)
• Last Synced: 2024-11-17T10:40:18.750Z (over 1 year ago)
• Topics: celery, crawler, crawling, darkweb, engine, python, redis, tor
• Language: Python
• Homepage: https://darklight.kr
• Size: 16.1 MB
• Stars: 10
• Watchers: 2
• Forks: 3
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-network-stuff - **24**星

README

          
# DarkLight Core Engine

Core Engine for collecting onion domains and crawling from webpage based on Tor network

## Main Features

* Crawling and capturing screenshot.

* Scanning well-known ports at target domain.

* Collecting artifacts from suspicious websites.

* Customize collector and pipeline if you want.

## Developer

* Namjun Kim ([@bunseokbot](https://github.com/bunseokbot))