{"id":24738880,"url":"https://github.com/proxzima/darkspider","last_synced_at":"2026-03-14T21:49:18.449Z","repository":{"id":50643229,"uuid":"519712281","full_name":"PROxZIMA/DarkSpider","owner":"PROxZIMA","description":"Anatomy and Visualization of the Network structure of the Dark web using multi-threaded crawler","archived":false,"fork":false,"pushed_at":"2024-07-27T18:01:35.000Z","size":8371,"stargazers_count":34,"open_issues_count":8,"forks_count":7,"subscribers_count":2,"default_branch":"master","last_synced_at":"2024-07-27T19:23:31.128Z","etag":null,"topics":["collaborate","crawler","dark-web","extractor","github","github-pages","hacktoberfest","networkx","onion","osint","python","scraper","tor"],"latest_commit_sha":null,"homepage":"https://proxzima.dev/DarkSpider/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/PROxZIMA.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":".github/CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":".github/CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-07-31T07:50:44.000Z","updated_at":"2024-07-27T19:23:34.335Z","dependencies_parsed_at":"2024-07-27T19:23:33.351Z","dependency_job_id":"64e4a911-f96f-4978-bcac-191ae9549c8c","html_url":"https://github.com/PROxZIMA/DarkSpider","commit_stats":null,"previous_names":[],"tags_count":3,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PROxZIMA%2FDarkSpider","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PROxZIMA%2FDarkSpider/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PROxZIMA%2FDarkSpider/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PROxZIMA%2FDarkSpider/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/PROxZIMA","download_url":"https://codeload.github.com/PROxZIMA/DarkSpider/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":235936090,"owners_count":19068828,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["collaborate","crawler","dark-web","extractor","github","github-pages","hacktoberfest","networkx","onion","osint","python","scraper","tor"],"created_at":"2025-01-27T22:55:51.837Z","updated_at":"2025-10-10T08:30:25.046Z","avatar_url":"https://github.com/PROxZIMA.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003c!--\n  Title: DarkSpider\n  Description: a python script to crawl and extract (regular or onion) webpages through the TOR network.\n  Author: PROxZIMA\n  --\u003e\n\n\u003ch1 align=\"center\"\u003e\n  \u003ca href=\"https://proxzima.dev/DarkSpider/\" target=\"_blank\"\u003e\n  \u003cimg src=\"assets/logo.png\" width=200 /\u003e\u003cbr\u003e\n  DarkSpider\n  \u003c/a\u003e\n\u003c/h1\u003e\n\n\u003ch4 align=\"center\"\u003eMultithreaded Crawler and Extractor for Dark Web\u003c/h4\u003e\n\n\u003cdiv align=\"center\"\u003e\n\n[![Version](https://img.shields.io/badge/version-2.0.1-green.svg?style=plastic)]() [![Python](https://img.shields.io/badge/python-v3-blue.svg?style=plastic)]() [![license](https://img.shields.io/github/license/PROxZIMA/DarkSpider.svg?style=plastic)]() [![Documentation](https://github.com/PROxZIMA/DarkSpider/actions/workflows/pages.yml/badge.svg)](https://proxzima.dev/DarkSpider/)\n\u003c/div\u003e\n\u003cbr/\u003e\n\n## Introduction\nDarkSpider is a multithreaded crawler and extractor for regular or onion webpages through the TOR network, written in Python.\n\n## Full Documentation\nSee the [Docs](https://proxzima.dev/DarkSpider/) for full documentation, examples, and other information.\n\n## Bugs and Feedback\nFor bugs, questions and discussions please use the [GitHub Issues](https://github.com/PROxZIMA/DarkSpider/issues).\n\n## Credits\n- [**@MikeMeliz**](https://github.com/MikeMeliz) for the initial [`TorCrawl`](https://github.com/MikeMeliz/TorCrawl.py) codebase.\n- Logo: [Spider Icon](https://stock.adobe.com/images/spider-icon-isolated-on-white-background-from-jungle-collection-spider-icon-trendy-and-modern-spider-symbol-for-logo-web-app-ui-spider-icon-simple-sign-spider-icon-flat-vector-illustration-for-g/355581671) by [Ayu](https://stock.adobe.com/contributor/209568715/ayu)\n- A. Alharbi et al., \"[Exploring the Topological Properties of the Tor Dark Web](https://ieeexplore.ieee.org/document/9340182)\", IEEE Access, vol. 9, pp. 21746-21758, 2021.\n- [Just the Docs](https://github.com/just-the-docs/just-the-docs)\n\n## License\n“GPL” stands for “General Public License”. Using the GNU GPL will require that all the released improved versions be free software. [source \u0026 more](https://www.gnu.org/licenses/gpl-faq.html)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fproxzima%2Fdarkspider","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fproxzima%2Fdarkspider","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fproxzima%2Fdarkspider/lists"}