Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/davemolk/searcher
Run a base query (plus optional add-ons) through ask, bing, brave, duck duck go, yahoo, and yandex.
https://github.com/davemolk/searcher
go golang infosec osint pentesting pentesting-tools recon research search search-engine security
Last synced: about 1 month ago
JSON representation
Run a base query (plus optional add-ons) through ask, bing, brave, duck duck go, yahoo, and yandex.
- Host: GitHub
- URL: https://github.com/davemolk/searcher
- Owner: davemolk
- License: mit
- Created: 2022-11-08T02:25:57.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2023-02-26T02:22:39.000Z (almost 2 years ago)
- Last Synced: 2024-06-20T00:33:57.258Z (7 months ago)
- Topics: go, golang, infosec, osint, pentesting, pentesting-tools, recon, research, search, search-engine, security
- Language: Go
- Homepage:
- Size: 2.4 MB
- Stars: 17
- Watchers: 2
- Forks: 1
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# searcher
Run a base query (plus optional add-ons) through ask, bing, brave, duck duck go, and yahoo.
## Overview
By default, this tool collects the URLs and result blurbs and prints them to stdout. You can pipe in additional terms that will be added to the base query. Print the results as json if you'd like, or save them to json files.
## Examples
```
$ cat terms.txt
microservices
mascot
cloud
cli
```
Let's use *golang* as our main search query and combine it with each of the above terms. We'll encode the search results as json and print to stdout and also save them as json files.
$ cat terms.txt | searcher -q golang -j -w -t
(make sure you include -t or the terms.txt won't be picked up!)
```
https://search.brave.com/search?q=golang+mascot
https://bing.com/search?q=golang+cloud
https://bing.com/search?q=golang+mascot
https://www.ask.com/web?q=golang+microservices
https://www.ask.com/web?q=golang+mascot
https://www.ask.com/web?q=golang+cli
https://search.brave.com/search?q=golang+cli
https://www.ask.com/web?q=golang+cloud
https://bing.com/search?q=golang+cli
https://bing.com/search?q=golang+microservices
https://search.brave.com/search?q=golang+microservices
https://search.brave.com/search?q=golang+cloud
https://html.duckduckgo.com/html?q=golang+cloud
https://html.duckduckgo.com/html?q=golang+cli
https://html.duckduckgo.com/html?q=golang+mascot
https://html.duckduckgo.com/html?q=golang+microservices
https://search.yahoo.com/search?p=golang+cloud
https://search.yahoo.com/search?p=golang+cli
https://search.yahoo.com/search?p=golang+mascot
https://search.yahoo.com/search?p=golang+microservices
```
the results are printed as JSON to the stdout and saved in the following files:
```
cli.json
cloud.json
mascot.json
microservices.json
```
where each file contains the JSON object (URL:blurb) for that particular term.
## Install
First, you'll need to [install go](https://golang.org/doc/install). Then, run the following command:
```
go install github.com/davemolk/searcher/cmd/searcher@latest
```
## Flags
```
Usage of searcher:
-c int
max number of goroutines to use at any given time
-e bool
exact matching for query
-j bool
print results as JSON
-q string
base search query
-os string
operating system (used in user agent and header creation)
-t bool
check stdin for additional search terms
-to int
request timeout (in ms)
-u bool
include urls in output
-v bool
verbose output
-w bool
write results to file
```
## Note
Each request gets a randomly assigned user agent corresponding to your os as well as appropriate headers (50/50 chance of chrome or firefox). Go unfortunately doesn't preserve header order, so if that's important to you and what you're up to, you'll have to look elsewhere.