https://github.com/priyamharsh14/prawler
Advance Proxy Scraper written in Python3
https://github.com/priyamharsh14/prawler
anonymity api find-proxies json proxy-scraper proxy-servers
Last synced: 15 days ago
JSON representation
Advance Proxy Scraper written in Python3
- Host: GitHub
- URL: https://github.com/priyamharsh14/prawler
- Owner: priyamharsh14
- License: gpl-3.0
- Created: 2019-08-07T03:16:26.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2020-09-03T07:11:45.000Z (over 4 years ago)
- Last Synced: 2024-08-09T03:53:14.472Z (9 months ago)
- Topics: anonymity, api, find-proxies, json, proxy-scraper, proxy-servers
- Language: Python
- Homepage:
- Size: 367 KB
- Stars: 27
- Watchers: 3
- Forks: 10
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
Awesome Lists containing this project
README
Advanced Proxy Scraper
## What is Prawler ?
Prawler finds best and working proxies from the internet in seconds. Proxies are used by developers, ethical hackers, pentesters and so on, in order to cover their tracks or bypass firewall restrictions. Prawler helps to find desired proxy in all possible formats.
## Features:
- Fast Proxy Server Scraping through multiple API's
- Extracts various types of Proxy Servers (HTTP, SOCKS4, SOCKS5)
- Scraps for Proxy Servers based on their Anonymity Level (Transparent, Anonymous, Elite)
- Find proxies from a specific country (using Country Codes)
- Various output formats available (List, JSON, TXT file)
## Installation:
New Installation:
```
pip install Prawler
```
Updating the package:
```
pip install --upgrade Prawler
```
## Usage:
We can use Prawler in several ways:
- **Find a single random proxy server**
Syntax:
```
Prawler.get_random_proxy(, )
```
Example:
```
import Prawler
proxy = Prawler.get_random_proxy("http", "elite")
```
- **Find all proxies in list format**
Syntax:
```
Prawler.get_proxy_list(, , , )
```
Example:
```
import Prawler
proxy_list = Prawler.get_proxy_list(5, "http", "elite")
```
or
```
import Prawler
proxy_list = Prawler.get_proxy_list(5, "http", "elite", "US")
```
- **Find all proxies in JSON format**
Syntax:
```
Prawler.get_proxy_json(, , , )
```
Example:
```
import Prawler
proxy_list = Prawler.get_proxy_json(5, "http", "elite")
```
or
```
import Prawler
proxy_list = Prawler.get_proxy_json(5, "http", "elite", "US")
```
- **Find all proxies and save it into a text file**
Syntax:
```
Prawler.get_proxy_txt(, , , , )
```
Example:
```
import Prawler
Prawler.get_proxy_txt("proxy_list.txt", 50, "http", "elite")
```
or
```
import Prawler
Prawler.get_proxy_txt("proxy_list.txt", 50, "http", "elite", "US")
```
## Note:
- **Valid Proxy Type:**
```
http, socks4, socks5
```
- **Valid Anonymity Level:**
```
all, elite, anonymous, transparent
```
- **Valid Country Codes:**
```
AF, AL, AM, AR, AT, AU, BA, BD, BG, BO, BR, BY, CA, CL, CM, CN, CO, CZ, DE, EC, EG, ES, FR, GB, GE, GN, GR, GT, HK, HN, HU, ID, IN, IQ, IR, IT, JP, KE, KG, KH, KR, KZ, LB, LT, LV, LY, MD, MM, MN, MU, MW, MX, MY, NG, NL, NO, NP, PE, PH, PK, PL, PS, PY, RO, RS, RU, SC, SE, SG, SK, SY, TH, TR, TW, TZ, UA, UG, US, VE, VN, ZA
```
## Donate:
If you feel this project was awesome, you can give me a cup of coffee :)
[](https://www.paypal.me/priyamharsh14)