https://github.com/bitwise-01/proxies
A Simple Proxy Scraper
https://github.com/bitwise-01/proxies
proxies scraper
Last synced: 10 months ago
JSON representation
A Simple Proxy Scraper
- Host: GitHub
- URL: https://github.com/bitwise-01/proxies
- Owner: Bitwise-01
- License: mit
- Created: 2018-05-03T19:28:48.000Z (about 8 years ago)
- Default Branch: master
- Last Pushed: 2019-03-18T04:16:30.000Z (over 7 years ago)
- Last Synced: 2025-04-09T20:44:58.684Z (about 1 year ago)
- Topics: proxies, scraper
- Language: Python
- Size: 4.88 KB
- Stars: 35
- Watchers: 4
- Forks: 14
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
### A simple proxy scraper
Get ten random proxies
```python
from scraper import Scraper
if __name__ == '__main__':
scraper = Scraper()
proxies = scraper.scrape(size=10)
while proxies.qsize:
proxy = proxies.get()
print(proxy)
```
Get proxies from Japan
```python
from scraper import Scraper
if __name__ == '__main__':
scraper = Scraper()
proxies = scraper.scrape(country='Japan')
while proxies.qsize:
proxy = proxies.get()
print(proxy)
```
Get three proxies from Japan
```python
from scraper import Scraper
if __name__ == '__main__':
scraper = Scraper()
proxies = scraper.scrape(country='Japan', size=3)
while proxies.qsize:
proxy = proxies.get()
print(proxy)
```
Get SSL proxies
```python
from scraper import Scraper
if __name__ == '__main__':
scraper = Scraper()
proxies = scraper.scrape(protocol='SSL')
while proxies.qsize:
proxy = proxies.get()
print(proxy)
```
Get SOCKS5 proxies
```python
from scraper import Scraper
if __name__ == '__main__':
scraper = Scraper()
proxies = scraper.scrape(protocol='SOCKS5')
while proxies.qsize:
proxy = proxies.get()
print(proxy)
```
Get proxies on port 8080
```python
from scraper import Scraper
if __name__ == '__main__':
scraper = Scraper()
proxies = scraper.scrape(port=8080)
while proxies.qsize:
proxy = proxies.get()
print(proxy)
```