Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/joswinemmanuel/info-collector
Info Collector gathers information from multiple search engines ( Google, Bing, Yahoo ), performs searches with a specified term, retrieves results, and saves them to separate files.
https://github.com/joswinemmanuel/info-collector
javascript nodemon puppeteer
Last synced: 4 days ago
JSON representation
Info Collector gathers information from multiple search engines ( Google, Bing, Yahoo ), performs searches with a specified term, retrieves results, and saves them to separate files.
- Host: GitHub
- URL: https://github.com/joswinemmanuel/info-collector
- Owner: joswinemmanuel
- License: mit
- Created: 2025-01-30T09:12:32.000Z (5 days ago)
- Default Branch: main
- Last Pushed: 2025-01-30T09:43:09.000Z (5 days ago)
- Last Synced: 2025-01-30T10:26:57.407Z (5 days ago)
- Topics: javascript, nodemon, puppeteer
- Language: JavaScript
- Homepage:
- Size: 22.5 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Info Collector collects information about someone using Google / Bing / Yahoo
This code is a bot that uses Puppeteer to collect information about someone from multiple search engines, including Google, Bing, and Yahoo!. It performs a search using a specified search term, retrieves the search results, and saves them to separate files.
## Prerequisites
Before running the code, make sure you have the following dependencies installed:
- Node.js
- Puppeteer
- `fs` module (built-in)
- `util` module (built-in)
- Nodemon (optional, for automatic script restart)
## Installation
To install the required dependencies, run the following command in your project directory:
```
npm install
```
## Usage
1. Modify the search functions `searchGoogle`, `searchBing`, and `searchYahoo` to use Puppeteer and perform the search for the given search term. These functions should return an array of search results.
2. Replace the placeholders `searchGoogle`, `searchBing`, and `searchYahoo` in the code with your actual implementations of the search functions.
3. Run the code using one of the following commands:
```
npm start "search data"
```
4. The code will execute the search functions for each search engine, retrieve the search results, and log the titles and links to the console.
5. Additionally, the search results will be saved to separate files:
`peopleInformation_yahoo.txt`
`peopleInformation_bing.txt`
`peopleInformation_google.txt`
## Output
The code will log the following information to the console:
- Titles and links of the search results from Yahoo.
- Titles and links of the search results from Bing.
- Titles and links of the search results from Google.
The search results will also be saved to separate JSON files:
`peopleInformation_yahoo.txt`
`peopleInformation_bing.txt`
`peopleInformation_google.txt`
Note: You can modify the search term and file names as per your requirements.
## Troubleshooting
If you encounter any issues while running the code, please ensure that:
- Puppeteer is properly installed and configured.
- The search functions (`searchGoogle`, `searchBing`, `searchYahoo`) are implemented correctly and return the expected results.
- The file write permissions are set correctly for the directory where the code is executed.
- The required dependencies (`fs`, `util`, `nodemon`) are installed.
If you have any further questions or need assistance, please don't hesitate to ask.