Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jesewe/proxy-checker
This script is designed to check the availability of HTTP, SOCKS4, and SOCKS5 proxies from various online sources.
https://github.com/jesewe/proxy-checker
proxy proxy-checker proxy-list python python3
Last synced: 4 days ago
JSON representation
This script is designed to check the availability of HTTP, SOCKS4, and SOCKS5 proxies from various online sources.
- Host: GitHub
- URL: https://github.com/jesewe/proxy-checker
- Owner: Jesewe
- License: mit
- Created: 2024-03-15T12:47:51.000Z (9 months ago)
- Default Branch: main
- Last Pushed: 2024-05-18T09:26:01.000Z (7 months ago)
- Last Synced: 2024-05-18T10:40:10.285Z (7 months ago)
- Topics: proxy, proxy-checker, proxy-list, python, python3
- Language: Python
- Homepage: https://github.com/Jesewe/proxy-checker
- Size: 19.5 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
ProxyChecker
A concurrent and efficient proxy checker for testing HTTP, SOCKS4, and SOCKS5 proxies, using multi-threading and automatic retry mechanisms.
Features •
Installation •
Usage •
Configuration •
Troubleshooting •
Contributing
---
# Overview
**ProxyChecker** is a Python tool designed to verify the functionality of a list of HTTP, SOCKS4, and SOCKS5 proxies by sending test requests. It supports concurrent requests for efficient performance, with configurable parameters to control timeouts, retry attempts, and the number of concurrent workers.
## Features
- **Multi-threaded Proxy Checking**: Uses Python's `ThreadPoolExecutor` for concurrent proxy testing.
- **Configurable Timeout and Retries**: Customize timeout per request and retry logic to handle intermittent network issues.
- **Supports HTTP, SOCKS4, SOCKS5 Proxies**: Works with multiple proxy types and fetches proxies from configurable URLs.
- **Automatic Output Saving**: Saves lists of working proxies for each type in a dedicated directory.
## Installation
### Prerequisites
- Python 3.6 or later
- `requests` package for handling HTTP requests
- `concurrent.futures` package for multi-threading support
### Steps
1. Clone the repository:
```bash
git clone https://github.com/Jesewe/proxy-checker.git
cd proxy-checker
```
2. Install the required packages:
```bash
pip install -r requirements.txt
```
## Usage
Run the following command to start checking proxies:
```bash
python proxy-checker.py
```
## Configuration
You can configure the following parameters in the `ProxyChecker` class or pass them during initialization:
- `proxy_urls`: Dictionary of URLs to fetch proxy lists for HTTP, SOCKS4, and SOCKS5.
- `timeout`: Timeout for each proxy request (default: 1 second).
- `max_retries`: Maximum retry attempts if fetching proxies fails (default: 3).
- `retry_delay`: Delay between retries (default: 1.0 seconds).
- `max_workers`: Maximum number of concurrent threads for proxy checking (default: 20).
Example of custom initialization:
```python
proxy_urls = {
"http": "https://raw.githubusercontent.com/TheSpeedX/PROXY-List/master/http.txt",
"socks4": "https://raw.githubusercontent.com/TheSpeedX/PROXY-List/master/socks4.txt",
"socks5": "https://raw.githubusercontent.com/TheSpeedX/PROXY-List/master/socks5.txt"
}
checker = ProxyChecker(proxy_urls, timeout=2, max_retries=5, retry_delay=1.5, max_workers=50)
checker.run()
```
## Troubleshooting
- **Connection Errors**: If you see multiple connection errors, consider lowering `max_workers` or increasing `timeout`.
- **Empty Output**: If the output files are empty, check if the proxy URLs are accessible and returning valid proxy lists.
- **Network Limits**: Avoid very high concurrency (e.g., `max_workers=100`) as it may cause network throttling or rate-limiting issues.
## Contributing
Contributions are welcome! Please fork the repository and submit a pull request for any enhancements or bug fixes.
## License
This project is licensed under the MIT License. See the [LICENSE](LICENSE) file for details.