https://github.com/scrapeless-ai/scrapeless-sdk-node
SDK to access Scrapeless API directly from Node.js. We handle Proxies, Scraping Browser, Scraping API, Web Unlocker and Captcha Solver for you.
https://github.com/scrapeless-ai/scrapeless-sdk-node
captcha-solver javascript nodejs proxies scrapeless scraper scraping-api scraping-browser sdk sdk-js webunlocker
Last synced: about 2 months ago
JSON representation
SDK to access Scrapeless API directly from Node.js. We handle Proxies, Scraping Browser, Scraping API, Web Unlocker and Captcha Solver for you.
- Host: GitHub
- URL: https://github.com/scrapeless-ai/scrapeless-sdk-node
- Owner: scrapeless-ai
- Created: 2024-11-22T08:07:00.000Z (5 months ago)
- Default Branch: main
- Last Pushed: 2025-02-12T08:40:23.000Z (2 months ago)
- Last Synced: 2025-02-26T22:46:29.851Z (about 2 months ago)
- Topics: captcha-solver, javascript, nodejs, proxies, scrapeless, scraper, scraping-api, scraping-browser, sdk, sdk-js, webunlocker
- Language: TypeScript
- Homepage: https://www.scrapeless.com
- Size: 42 KB
- Stars: 1
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Scrapeless Node.js SDK
## Install
```shell
npm install scrapeless-sdk-node
```
## Usage
Start using the API with your [API KEY](https://app.scrapeless.com/dashboard/account?tab=apiKey)
For more examples, please refer to the `examples` directory
For more information, please refer to our [documentation](https://docs.scrapeless.com/)
### Scraping API
```js
import Scrapeless from 'scrapeless-sdk-node';
(async () => {
const scrapeless = new Scrapeless({ apiKey: 'YOUR-API-KEY' });
const response = await scrapeless.scraper({
actor: "scraper.shopee",
webhook: "",
input: {
type: "shopee.search",
url: "https://shopee.tw/2312312.10228173.24803858474",
}
});
})();
```
### Web Unlocker
```js
import Scrapeless from 'scrapeless-sdk-node';
(async () => {
const scrapeless = new Scrapeless({ apiKey: 'YOUR-API-KEY' });
const result = await scrapeless.unlocker({
actor: 'unlocker.webunlocker',
input: {
url: "https://www.scrapeless.com",
proxy_country: "ANY",
method: "GET",
redirect: false,
}
});
console.log(result)
})();
```
### Captcha Solver
#### Create captcha task
```js
import Scrapeless from 'scrapeless-sdk-node';
(async () => {
const scrapeless = new Scrapeless({ apiKey: 'YOUR-API-KEY' });
const result = await scrapeless.createCaptchaTask({
actor: 'captcha.recaptcha',
input: {
version: "v2",
pageURL: "https://www.google.com",
siteKey: "6Le-wvkSAAAAAPBMRTvw0Q4Muexq9bi0DJwx_mJ-",
pageAction: ""
}
})
console.log(result)
})();
```
#### Get captcha task result
```js
import Scrapeless from 'scrapeless-sdk-node';
(async () => {
const scrapeless = new Scrapeless({ apiKey: 'YOUR-API-KEY' });
const result = await scrapeless.getCaptchaTaskResult('task-id');
console.log(result)
})();
```
#### Solver captcha
```js
import Scrapeless from 'scrapeless-sdk-node';
(async () => {
const scrapeless = new Scrapeless({ apiKey: 'YOUR-API-KEY' });
const result = await scrapeless.solverCaptcha({
actor: 'captcha.recaptcha',
input: {
version: "v2",
pageURL: "https://www.google.com",
siteKey: "6Le-wvkSAAAAAPBMRTvw0Q4Muexq9bi0DJwx_mJ-",
pageAction: ""
}
}, 5000);
console.log(result)
})();
```
### Scraping Browser
```js
import puppeteer from 'puppeteer-core';
const connectionURL = 'wss://api.scrapeless.com/browser?token=your-api-key&session_ttl=180&proxy_country=ANY';
(async () => {
const browser = await puppeteer.connect({browserWSEndpoint: connectionURL});
const page = await browser.newPage();
await page.goto('https://www.scrapeless.com');
console.log(await page.title());
await browser.close();
})();
```
### Proxies
```js
import axios from 'axios';
const url = "https://api.ipapi.is/";
axios.get(url, {
proxy: {
protocol: 'http',
host: 'gw-us.scrapeless.io',
port: 8789,
auth: {
username: '5DB185CB7843-proxy-country_US-r_10m-s_8VEfHAWwXV',
password: 'qtNm2G1L'
}
}
}).then((res) => {
console.log(res.data);
}).catch((err) => {
console.log('[err]:', err);
});
```