{"id":13586209,"url":"https://github.com/vlall/Darksearch","last_synced_at":"2025-04-07T14:34:01.083Z","repository":{"id":3330885,"uuid":"47710491","full_name":"vlall/Darksearch","owner":"vlall","description":":mag::shipit: Search engine for hidden material. Scraping dark web onions, irc logs, deep web etc...","archived":false,"fork":false,"pushed_at":"2022-12-26T20:14:58.000Z","size":545,"stargazers_count":461,"open_issues_count":14,"forks_count":87,"subscribers_count":34,"default_branch":"master","last_synced_at":"2024-08-03T17:12:07.765Z","etag":null,"topics":["dark-web","darkweb","deep-web","search","search-engine"],"latest_commit_sha":null,"homepage":"http://darksearch.com","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/vlall.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2015-12-09T18:25:56.000Z","updated_at":"2024-08-01T05:45:28.000Z","dependencies_parsed_at":"2023-01-11T16:16:39.387Z","dependency_job_id":null,"html_url":"https://github.com/vlall/Darksearch","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vlall%2FDarksearch","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vlall%2FDarksearch/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vlall%2FDarksearch/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vlall%2FDarksearch/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/vlall","download_url":"https://codeload.github.com/vlall/Darksearch/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":223285170,"owners_count":17119852,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["dark-web","darkweb","deep-web","search","search-engine"],"created_at":"2024-08-01T15:05:23.955Z","updated_at":"2024-11-06T04:31:14.894Z","avatar_url":"https://github.com/vlall.png","language":"Python","funding_links":[],"categories":["Python"],"sub_categories":[],"readme":"[![Build Status](https://travis-ci.org/vlall/darksearch.svg?branch=master)](https://travis-ci.org/vlall/darksearch)\n\n###About Darksearch\n[Darksearch](http://www.darksearch.com) allows you to query cached onion sites, irc chatrooms, various pdfs, game chats, blackhat forums etc...\n\u003cimg src=\"https://raw.githubusercontent.com/vlall/darksearch/master/darksearch/docs/darksearch.png\" width=\"700\"\u003e\n## API\nDarksearch also has an API in the works. Currently you can't scrape specific data for your queries, but you can retrieve metadata on your searches by using a GET request on darksearch.io/api/YOUR_QUERY/PAGE_NUMBER\n```\n$ curl -XGET darksearch.com/api/spies/1\n\n{\n  \"Duration\": \"0.026\", \n  \"Query\": \"spies\", \n  \"Results\": \"{'10': {'10': {'Host': u'http://ss2v6i44b3vy4tdf.onion//advisory-board/', 'Description': u\\\"live in hiding for a year and face arrest her partner was imprisoned twice for exposing the crimes of the \u003cfont color='red'\u003e\u003cb\u003espies\u003c/b\u003e\u003c/font\u003e she is the author of spies lies and whistleblowers mi5 and the david shayler affair she is now a\\\", 'Timestamp (scraped)': u'2016-04-24 08:02:57', 'Title': u'Advisory Board Courage Foundation', 'URL': u'ss2v6i44b3vy4tdf.onion/advisory-board.html', 'Tor2Web (.cab)': u'ss2v6i44b3vy4tdf.onion.cab/advisory-board.html', 'Tor2Web (.to)': u'ss2v6i44b3vy4tdf.onion.to/advisory-board.html', 'Size (bytes)': 39006}}, '1': {'1': {'Host': u'http://maskravvbmurcaiz.onion/', 'Description': u\\\"maskrabbit maskrabbit maskrabbit is an anonymous agency for real world operators we specialize in couriers thieves \u003cfont color='red'\u003e\u003cb\u003espies\u003c/b\u003e\u003c/font\u003e saboteurs hackers and goons maskrabbit only works with professional agents and serious clients to apply use the appropriate form to submit your needs\\\", 'Timestamp (scraped)': u'2016-04-21 09:53:20', 'Title': u'MaskRabbit', 'URL': u'maskravvbmurcaiz.onion/index.html', 'Tor2Web (.cab)': u'maskravvbmurcaiz.onion.cab/index.html', 'Tor2Web (.to)': u'maskravvbmurcaiz.onion.to/index.html', 'Size (bytes)': 1668}}, '3': {'3': {'Host': u'http://uksfvgmwpiww3n4s.onion/', 'Description': u\\\"when gov imprison bradly manning and torture him until he says he is guilty in the time when they setup \u003cfont color='red'\u003e\u003cb\u003espies\u003c/b\u003e\u003c/font\u003e and sexual crime to imprison julian assange do you really believe that gov will be stopped in legal way\\\", 'Timestamp (scraped)': u'2016-04-23 10:50:27', 'Title': u'Our reality', 'URL': u'uksfvgmwpiww3n4s.onion/index.html', 'Tor2Web (.cab)': u'uksfvgmwpiww3n4s.onion.cab/index.html', 'Tor2Web (.to)': u'uksfvgmwpiww3n4s.onion.to/index.html', 'Size (bytes)': 3495}}, '2': {'2': {'Host': u'http://ac4jrkjk4ialqkoh.onion/category/revealed-documents/', 'Description': u\\\"this gchq manual from 2008 explains how analysts would unscramble the video signals from israeli drones see the intercept article \u003cfont color='red'\u003e\u003cb\u003espies\u003c/b\u003e\u003c/font\u003e in the sky israeli drone feeds hacked by british and american intellience 29 january 2016 continue reading s455n israeli\\\", 'Timestamp (scraped)': u'2016-04-21 08:54:29', 'Title': u'Revealed documents Courage Snowden', 'URL': u'ac4jrkjk4ialqkoh.onion/category/revealed-documents.html', 'Tor2Web (.cab)': u'ac4jrkjk4ialqkoh.onion.cab/category/revealed-documents.html', 'Tor2Web (.to)': u'ac4jrkjk4ialqkoh.onion.to/category/revealed-documents.html', 'Size (bytes)': 36944}}, '4': {'4': {'Host': u'http://lcvkso2t5t3cmy3x.onion/', 'Description': u\\\"provide his blackberry phone password to canada border services agency cbsa officers at a halifax airport 2015 02 25 canadian \u003cfont color='red'\u003e\u003cb\u003espies\u003c/b\u003e\u003c/font\u003e collect domestic emails in secret security sweep the communications security establishment cse is covertly monitoring canadians emails 2015 01\\\", 'Timestamp (scraped)': u'2016-04-22 06:45:48', 'Title': u'Hack Canada', 'URL': u'lcvkso2t5t3cmy3x.onion/index.html', 'Tor2Web (.cab)': u'lcvkso2t5t3cmy3x.onion.cab/index.html', 'Tor2Web (.to)': u'lcvkso2t5t3cmy3x.onion.to/index.html', 'Size (bytes)': 9269}}, '6': {'6': {'Host': u'http://h2am5w5ufhvdifrs.onion', 'Description': u\\\"november 20 2013 2013 1612 htm bis end user certificates for china november 20 2013 2013 1611 pdf fisc usa \u003cfont color='red'\u003e\u003cb\u003espies\u003c/b\u003e\u003c/font\u003e deny release of doc to aclu nobember 19 2013 2013 1610 vid video nsa ddir inglis at ny law\\\", 'Timestamp (scraped)': u'2016-04-21 11:39:09', 'Title': u'Cryptome', 'URL': u'h2am5w5ufhvdifrs.onion/index.html', 'Tor2Web (.cab)': u'h2am5w5ufhvdifrs.onion.cab/index.html', 'Tor2Web (.to)': u'h2am5w5ufhvdifrs.onion.to/index.html', 'Size (bytes)': 66052}}, '9': {'9': {'Host': u'http://swehackmzys2gpmb.onion/./viewforum.php?f=21\u0026amp;sid=51857442da28cbcb1e47336b287b2960', 'Description': u\\\"33 1 2 3 svar 27 27 svar 2842 visningar senaste inl gget av avlidienbrunn 18 apr 2016 13 14 \u003cfont color='red'\u003e\u003cb\u003espies\u003c/b\u003e\u003c/font\u003e in the skies artikel om fbi s flyg vervakning av chlo 13 apr 2016 03 50 svar 5 5\\\", 'Timestamp (scraped)': u'2016-04-22 18:45:05', 'Title': u'Lektyr och media swehack org', 'URL': u'swehackmzys2gpmb.onion/./viewforum.php?f=21\u0026amp;sid=51857442da28cbcb1e47336b287b2960', 'Tor2Web (.cab)': u'swehackmzys2gpmb.onion.cab/./viewforum.php?f=21\u0026amp;sid=51857442da28cbcb1e47336b287b2960', 'Tor2Web (.to)': u'swehackmzys2gpmb.onion.to/./viewforum.php?f=21\u0026amp;sid=51857442da28cbcb1e47336b287b2960', 'Size (bytes)': 48200}}, '8': {'8': {'Host': u'http://swehackmzys2gpmb.onion/./viewforum.php?f=21\u0026amp;sid=3941cd89256fc9b6c7561ccaa4d3a9a1', 'Description': u\\\"33 1 2 3 svar 27 27 svar 2769 visningar senaste inl gget av avlidienbrunn 18 apr 2016 13 14 \u003cfont color='red'\u003e\u003cb\u003espies\u003c/b\u003e\u003c/font\u003e in the skies artikel om fbi s flyg vervakning av chlo 13 apr 2016 03 50 svar 5 5\\\", 'Timestamp (scraped)': u'2016-04-21 07:22:11', 'Title': u'Lektyr och media swehack org', 'URL': u'swehackmzys2gpmb.onion/./viewforum.php?f=21\u0026amp;sid=3941cd89256fc9b6c7561ccaa4d3a9a1', 'Tor2Web (.cab)': u'swehackmzys2gpmb.onion.cab/./viewforum.php?f=21\u0026amp;sid=3941cd89256fc9b6c7561ccaa4d3a9a1', 'Tor2Web (.to)': u'swehackmzys2gpmb.onion.to/./viewforum.php?f=21\u0026amp;sid=3941cd89256fc9b6c7561ccaa4d3a9a1', 'Size (bytes)': 48175}}}\", \n  \"Total Pages\": \"4\", \n  \"Total Results\": \"40\"\n}\n```\n\nThe Darksearch index is growing as more scrapers get built...\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvlall%2FDarksearch","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fvlall%2FDarksearch","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvlall%2FDarksearch/lists"}