https://github.com/odynvolk/bing-me-links
A simple node module for scraping Baidu, Bing, StartPage, Yahoo and Qwant
https://github.com/odynvolk/bing-me-links
baidu bing javascript nodejs scraper startpage webcrawler yahoo
Last synced: 6 months ago
JSON representation
A simple node module for scraping Baidu, Bing, StartPage, Yahoo and Qwant
- Host: GitHub
- URL: https://github.com/odynvolk/bing-me-links
- Owner: odynvolk
- Created: 2016-10-30T12:05:38.000Z (almost 9 years ago)
- Default Branch: master
- Last Pushed: 2017-03-30T17:29:20.000Z (over 8 years ago)
- Last Synced: 2024-10-04T16:47:35.027Z (about 1 year ago)
- Topics: baidu, bing, javascript, nodejs, scraper, startpage, webcrawler, yahoo
- Language: JavaScript
- Homepage:
- Size: 16.6 KB
- Stars: 3
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: HISTORY.md
Awesome Lists containing this project
README
# bing-me-links
> A simple node module for scraping links from the Baidu, Bing, StartPage, Webcrawler, Yahoo, and Qwant search engines.
## Install
Install with [npm](https://www.npmjs.com/)
```sh
$ npm install bing-me-links --save
```
## Usage
BingMeLinks uses the [exp-config](https://github.com/ExpressenAB/exp-config) module for handling its' configuration in JSON files.
```js
const bingMeLinks = require("bing-me-links");
const vo = require("vo");
const query = "javascript";
const baidu = vo(bingMeLinks.searchBaidu(query));
vo(baidu)
.then((links) => {
//=> ["http://whatever1", "http://whatever2"]
});
const bing = vo(bingMeLinks.searchBing(query));
vo(bing)
.then((links) => {
//=> ["http://whatever1", "http://whatever2"]
});
const startPage = vo(bingMeLinks.searchStartPage(query));
vo(startPage)
.then((links) => {
//=> ["http://whatever1", "http://whatever2"]
});
const webcrawler = vo(bingMeLinks.searchWebcrawler(query));
vo(webcrawler)
.then((links) => {
//=> ["http://whatever1", "http://whatever2"]
});
const yahoo = vo(bingMeLinks.searchYahoo(query));
vo(yahoo)
.then((links) => {
//=> ["http://whatever1", "http://whatever2"]
});
const qwant = vo(bingMeLinks.searchQwant(query));
vo(qwant)
.then((links) => {
//=> ["http://whatever1", "http://whatever2"]
});
````
## Running tests
Install dev dependencies:
```sh
$ npm test
```
## Contributing
Pull requests and stars are always welcome. For bugs and feature requests, [please create an issue](https://github.com/odynvolk/bing-me-links/issues/new)
## Author
+ [github/odynvolk](https://github.com/odynvolk)
## License
Released under the MIT license.