https://github.com/howz1t/py_proxy
Python proxy helper. Please use deligently and respectfully! Always respect a websites ROBOTS.txt!
https://github.com/howz1t/py_proxy
Last synced: 10 months ago
JSON representation
Python proxy helper. Please use deligently and respectfully! Always respect a websites ROBOTS.txt!
- Host: GitHub
- URL: https://github.com/howz1t/py_proxy
- Owner: HOWZ1T
- License: mit
- Created: 2018-04-15T11:47:12.000Z (about 8 years ago)
- Default Branch: master
- Last Pushed: 2019-03-08T16:55:39.000Z (over 7 years ago)
- Last Synced: 2025-04-07T01:41:58.071Z (about 1 year ago)
- Language: Python
- Size: 8.32 MB
- Stars: 9
- Watchers: 2
- Forks: 5
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# py_proxy
Python proxy manager.
Please use diligently and respectfully.
Always respect a website's ROBOTS.txt
## compatibility
This library is compatible with python 3
## dependencies
This library is dependant on:
- requests
- beautifulsoup4
## install
```bash
pip install py_proxy
```
## Features
- Automatically fetches up to 80 proxies
- Cycle between proxies easily
- Test a proxy and get details about the proxy
- Validate all fetched proxies concurrently
- Format proxies for use with requests library
## Examples
```python
from proxy import Proxy
proxy = Proxy()
# getting the current proxy
cur_proxy = proxy.proxy
# testing the current proxy
res = proxy.test_proxy(cur_proxy)
if res == 1:
print("success!")
else:
print("failure!")
# cycling the proxy to a new proxy from the pool
proxy.cycle()
# filtering proxies by a country code
proxy = Proxy("US") #gets US only proxies from the pool
# automatically validating proxies after fetching them
proxy = Proxy(validate_proxies=True)
# format a proxy for use with requests library
ip = "100.100.100.100" #example ip, not real
port = "1989" #example port, not real
addr = [ip, port]
proxies = proxy.format_proxy(addr) #returns the requests proxies dictionary
# validating all proxies concurrently
proxy.validate_proxies()
# cycling through valid only proxies
proxy.cycle(valid_only=True)
```
## License
You're free to use this package which is licensed under the [MIT-LICENSE](LICENSE)
## Contributing
Contribution is always appreciated.
If you are contributing please remember to update the README.
If your contribution is accepted you will be credited for it.
## Original Author
[Dylan Randall aka HOWZ1T](https://github.com/howz1t)
## Contributors
[Berkkarahan](https://github.com/berkkarahan) - added multi-thread proxy validation