Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/proxzima/darkspider

Anatomy and Visualization of the Network structure of the Dark web using multi-threaded crawler
https://github.com/proxzima/darkspider

collaborate crawler dark-web extractor github github-pages hacktoberfest networkx onion osint python scraper tor

Last synced: 2 days ago
JSON representation

Anatomy and Visualization of the Network structure of the Dark web using multi-threaded crawler

Host: GitHub
URL: https://github.com/proxzima/darkspider
Owner: PROxZIMA
License: gpl-3.0
Created: 2022-07-31T07:50:44.000Z (over 2 years ago)
Default Branch: master
Last Pushed: 2024-07-27T18:01:35.000Z (6 months ago)
Last Synced: 2024-07-27T19:23:31.128Z (6 months ago)
Topics: collaborate, crawler, dark-web, extractor, github, github-pages, hacktoberfest, networkx, onion, osint, python, scraper, tor
Language: Python
Homepage: https://proxzima.dev/DarkSpider/
Size: 7.98 MB
Stars: 34
Watchers: 2
Forks: 7
Open Issues: 8
Metadata Files:
- Readme: README.md
- Contributing: .github/CONTRIBUTING.md
- License: LICENSE
- Code of conduct: .github/CODE_OF_CONDUCT.md

Awesome Lists containing this project

README

        



  

  


  DarkSpider

  



Multithreaded Crawler and Extractor for Dark Web




[![Version](https://img.shields.io/badge/version-2.0.1-green.svg?style=plastic)]() [![Python](https://img.shields.io/badge/python-v3-blue.svg?style=plastic)]() [![license](https://img.shields.io/github/license/PROxZIMA/DarkSpider.svg?style=plastic)]() [![Documentation](https://github.com/PROxZIMA/DarkSpider/actions/workflows/pages.yml/badge.svg)](https://proxzima.dev/DarkSpider/)






## Introduction

DarkSpider is a multithreaded crawler and extractor for regular or onion webpages through the TOR network, written in Python.

## Full Documentation

See the [Docs](https://proxzima.dev/DarkSpider/) for full documentation, examples, and other information.

## Bugs and Feedback

For bugs, questions and discussions please use the [GitHub Issues](https://github.com/PROxZIMA/DarkSpider/issues).

## Credits

- [**@MikeMeliz**](https://github.com/MikeMeliz) for the initial [`TorCrawl`](https://github.com/MikeMeliz/TorCrawl.py) codebase.

- Logo: [Spider Icon](https://stock.adobe.com/images/spider-icon-isolated-on-white-background-from-jungle-collection-spider-icon-trendy-and-modern-spider-symbol-for-logo-web-app-ui-spider-icon-simple-sign-spider-icon-flat-vector-illustration-for-g/355581671) by [Ayu](https://stock.adobe.com/contributor/209568715/ayu)

- A. Alharbi et al., "[Exploring the Topological Properties of the Tor Dark Web](https://ieeexplore.ieee.org/document/9340182)", IEEE Access, vol. 9, pp. 21746-21758, 2021.

- [Just the Docs](https://github.com/just-the-docs/just-the-docs)

## License

“GPL” stands for “General Public License”. Using the GNU GPL will require that all the released improved versions be free software. [source & more](https://www.gnu.org/licenses/gpl-faq.html)