{"id":22619582,"url":"https://github.com/davemolk/searcher","last_synced_at":"2025-04-11T15:21:06.308Z","repository":{"id":64782470,"uuid":"563152170","full_name":"davemolk/searcher","owner":"davemolk","description":"Run a base query (plus optional add-ons) through ask, bing, brave, duck duck go, yahoo, and yandex.","archived":false,"fork":false,"pushed_at":"2023-02-26T02:22:39.000Z","size":2518,"stargazers_count":21,"open_issues_count":1,"forks_count":3,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-03-25T11:22:05.473Z","etag":null,"topics":["go","golang","infosec","osint","pentesting","pentesting-tools","recon","research","search","search-engine","security"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/davemolk.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2022-11-08T02:25:57.000Z","updated_at":"2025-02-07T08:32:28.000Z","dependencies_parsed_at":"2023-12-10T11:45:47.079Z","dependency_job_id":null,"html_url":"https://github.com/davemolk/searcher","commit_stats":{"total_commits":20,"total_committers":2,"mean_commits":10.0,"dds":"0.050000000000000044","last_synced_commit":"0617d859f5414bb1414bdfce95dfff3e731f24f7"},"previous_names":[],"tags_count":4,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/davemolk%2Fsearcher","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/davemolk%2Fsearcher/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/davemolk%2Fsearcher/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/davemolk%2Fsearcher/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/davemolk","download_url":"https://codeload.github.com/davemolk/searcher/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248429129,"owners_count":21101786,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["go","golang","infosec","osint","pentesting","pentesting-tools","recon","research","search","search-engine","security"],"created_at":"2024-12-08T22:06:29.198Z","updated_at":"2025-04-11T15:21:06.280Z","avatar_url":"https://github.com/davemolk.png","language":"Go","funding_links":[],"categories":["[](#table-of-contents) Table of contents"],"sub_categories":["[](#universal-search-tools)Universal search tools"],"readme":"# searcher\nRun a base query (plus optional add-ons) through ask, bing, brave, duck duck go, and yahoo.\n\n## Overview\nBy default, this tool collects the URLs and result blurbs and prints them to stdout. You can pipe in additional terms that will be added to the base query. Print the results as json if you'd like, or save them to json files.\n\n## Examples\n```\n$ cat terms.txt\nmicroservices\nmascot\ncloud\ncli\n```\nLet's use *golang* as our main search query and combine it with each of the above terms. We'll encode the search results as json and print to stdout and also save them as json files.\n\n$ cat terms.txt | searcher -q golang -j -w -t\n(make sure you include -t or the terms.txt won't be picked up!)\n```\nhttps://search.brave.com/search?q=golang+mascot\nhttps://bing.com/search?q=golang+cloud\nhttps://bing.com/search?q=golang+mascot\nhttps://www.ask.com/web?q=golang+microservices\nhttps://www.ask.com/web?q=golang+mascot\nhttps://www.ask.com/web?q=golang+cli\nhttps://search.brave.com/search?q=golang+cli\nhttps://www.ask.com/web?q=golang+cloud\nhttps://bing.com/search?q=golang+cli\nhttps://bing.com/search?q=golang+microservices\nhttps://search.brave.com/search?q=golang+microservices\nhttps://search.brave.com/search?q=golang+cloud\nhttps://html.duckduckgo.com/html?q=golang+cloud\nhttps://html.duckduckgo.com/html?q=golang+cli\nhttps://html.duckduckgo.com/html?q=golang+mascot\nhttps://html.duckduckgo.com/html?q=golang+microservices\nhttps://search.yahoo.com/search?p=golang+cloud\nhttps://search.yahoo.com/search?p=golang+cli\nhttps://search.yahoo.com/search?p=golang+mascot\nhttps://search.yahoo.com/search?p=golang+microservices\n```\nthe results are printed as JSON to the stdout and saved in the following files:\n```\ncli.json\ncloud.json\nmascot.json\nmicroservices.json\n```\nwhere each file contains the JSON object (URL:blurb) for that particular term.\n\n## Install\nFirst, you'll need to [install go](https://golang.org/doc/install). Then, run the following command:\n\n```\ngo install github.com/davemolk/searcher/cmd/searcher@latest\n```\n\n## Flags\n```\nUsage of searcher:\n  -c int\n    \tmax number of goroutines to use at any given time\n  -e bool\n    \texact matching for query\n  -j bool\n    \tprint results as JSON\n  -q string\n    \tbase search query\n  -os string\n    \toperating system (used in user agent and header creation)\n  -t bool\n    \tcheck stdin for additional search terms\n  -to int\n    \trequest timeout (in ms)\n  -u bool\n    \tinclude urls in output\n  -v bool\n    \tverbose output\n  -w bool\n    \twrite results to file\n```\n\n## Note\nEach request gets a randomly assigned user agent corresponding to your os as well as appropriate headers (50/50 chance of chrome or firefox). Go unfortunately doesn't preserve header order, so if that's important to you and what you're up to, you'll have to look elsewhere.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdavemolk%2Fsearcher","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdavemolk%2Fsearcher","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdavemolk%2Fsearcher/lists"}