Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/1uc1f3r616/fastproxy

MultiThreaded Application to Scrape Working Web Proxies
https://github.com/1uc1f3r616/fastproxy

hide ip live proxy python scrape security threading web

Last synced: 3 days ago
JSON representation

MultiThreaded Application to Scrape Working Web Proxies

Host: GitHub
URL: https://github.com/1uc1f3r616/fastproxy
Owner: 1UC1F3R616
License: mit
Created: 2019-09-04T18:13:03.000Z (about 5 years ago)
Default Branch: master
Last Pushed: 2020-07-25T15:01:13.000Z (over 4 years ago)
Last Synced: 2024-11-08T00:42:10.532Z (7 days ago)
Topics: hide, ip, live, proxy, python, scrape, security, threading, web
Language: Python
Homepage: https://pypi.org/project/fastProxy/
Size: 53.7 KB
Stars: 31
Watchers: 3
Forks: 10
Open Issues: 1
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

        


  





  MultiThreaded Application to Scrape Working Web Proxies



  



	



---

[![forthebadge made-with-python](http://ForTheBadge.com/images/badges/made-with-python.svg)](https://www.python.org/)

[![Open Source Love png3](https://badges.frapsoft.com/os/v3/open-source.png?v=103)](https://github.com/ellerbrock/open-source-badges/)

[![Maintenance](https://img.shields.io/badge/Maintained%3F-yes-green.svg)](https://GitHub.com/1UC1F3R616/fastProxy)

## Functionalites

- [x] More than 300 Live Proxy Fetch

- [x] CLI Support

- [x] Selection of Proxy based on Speed

- [x] Proxy Export

- [ ] Country Filteration

## Installation

### pip install

```bash

pip install fastProxy==0.1.3

```

### git clone

```text

git clone https://github.com/1UC1F3R616/fastProxy.git

cd fastProxy/

pip install -r requirements.txt

```

## Run using CLI

#### Default run

- Threads: 100

- Request Timeout: 4sec

```bash

python fastProxy.py 

```

#### Aletered Parameters

| Flag        | Usage           | Purpose  |  Default  |  Usage  |

| ------------- |:-------------:|:-----:|:-----:|:-----:|

| c     | Thread Count | Increase Testing Speed |   100 | `--c=16`  |

| t      | Request Timeout in sec    |   Give Faster Proxy when set to lower Values | 4 | `--t=20`  |

| g | Generate CSV      |  Generate CSV of Working proxy only with user flags| False | `--g` |

| a | All Scraped Proxy     |  Generate CSV of All Scrapped Proxies with more Detail  | False | `--a` |

```bash

python fastProxy.py --c=256 --t=2 --g --a 

```

## Run by import

- Set Flags or Default Values are Taken

| Flag        | Usage           | Purpose  |  Default  | Usage|

| ------------- |:-------------:|:-----:|:-----:|:-----:|

| c     | Thread Count | Increase Testing Speed |   100 | `c=256`|

| t      | Request Timeout in sec    |   Give Faster Proxy when set to lower Values| 4 | `t=2` |

| g | Generate CSV      |  Generate CSV of Working proxy only with user flags| False | `g=True`|

| a | All Scraped Proxy     |  Generate CSV of All Scrapped Proxies with more Detail  | False | `a=True`|

```py

import fastProxy

myProxyList = fastProxy.fetch_proxies(c=128, t=2, g=True, a=True)

print(myProxyList)

```

#### Sample [CSV File](https://github.com/1UC1F3R616/fastProxy/blob/master/Sample/all_proxies.csv)

[![LinkedIn](https://img.shields.io/static/v1.svg?label=Connect&message=@Kush&color=grey&logo=linkedin&labelColor=blue&style=social)](https://www.linkedin.com/in/kush-choudhary-567b38169?lipi=urn%3Ali%3Apage%3Ad_flagship3_profile_view_base_contact_details%3BDYkgbUGhTniMSRqOUkdN3A%3D%3D)

[![LinkedIn](https://img.shields.io/static/v1.svg?label=Connect&message=@Dhruv&color=grey&logo=linkedin&labelColor=blue&style=social)](https://www.linkedin.com/in/dhruv-agarwal-043ab3179/?lipi=urn%3Ali%3Apage%3Ad_flagship3_profile_view_base_contact_details%3BDYkgbUGhTniMSRqOUkdN3A%3D%3D)