https://github.com/cnmenghan/pyproxylisttest
A multi-protocol proxy server testing tool that supports HTTP, HTTPS, SOCKS4 and SOCKS5 protocols. Through concurrent testing and intelligent verification mechanisms, it can quickly detect the availability and latency of proxy servers. It is suitable for scenarios such as web crawlers, data collection and privacy protection.
https://github.com/cnmenghan/pyproxylisttest
async concurrent-requests https-proxy latency-measurement multithreading network-security network-tools proxy-checker proxy-list proxy-tester requests-library-python socks-proxy web-scraping-tools
Last synced: 2 months ago
JSON representation
A multi-protocol proxy server testing tool that supports HTTP, HTTPS, SOCKS4 and SOCKS5 protocols. Through concurrent testing and intelligent verification mechanisms, it can quickly detect the availability and latency of proxy servers. It is suitable for scenarios such as web crawlers, data collection and privacy protection.
- Host: GitHub
- URL: https://github.com/cnmenghan/pyproxylisttest
- Owner: CNMengHan
- License: mit
- Created: 2025-02-06T22:29:27.000Z (4 months ago)
- Default Branch: main
- Last Pushed: 2025-02-06T22:50:40.000Z (4 months ago)
- Last Synced: 2025-02-14T11:05:30.324Z (4 months ago)
- Topics: async, concurrent-requests, https-proxy, latency-measurement, multithreading, network-security, network-tools, proxy-checker, proxy-list, proxy-tester, requests-library-python, socks-proxy, web-scraping-tools
- Language: Python
- Homepage:
- Size: 8.79 KB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# 🔍 PyProxyListTest
**A multi-protocol proxy server testing tool that supports HTTP, HTTPS, SOCKS4 and SOCKS5 protocols. Through concurrent testing and intelligent verification mechanisms, it can quickly detect the availability and latency of proxy servers. It is suitable for scenarios such as web crawlers, data collection and privacy protection.**
## 🚀 Features
- **Protocol Diversity**: Tests proxies through 4 core protocols:
- HTTP/HTTPS
- SOCKS4/SOCKS4a
- SOCKS5/SOCKS5h
- **Concurrent Testing**: 50-thread concurrent verification
- **Smart Latency Measurement**:
- Auto-selects fastest valid protocol variant
- Tests against multiple targets:
- httpbin.org (primary validation)
- Baidu (中国站点)
- Bing China
- **Clear Reporting**: Visual results with success/failure indicators and latency metrics
## ⚙️ Installation
```bash
pip install requests
git clone https://github.com/CNMengHan/PyProxyListTest.git
cd PyProxyListTest
```
## 🧮 Usage
```python
# Update proxies list first!
nano proxies.txt
# Run the tester
python main.py
```
**Result Legend**:
- ✅ `Protocol`: Working (with latency in ms)
- ❌ `Protocol`: Not supported
## 🛠 Technical Implementation
- **Core Libraries**:
- `requests` for HTTP communication
- `concurrent.futures` for thread pooling
- **Test Logic**:
1. Sequential protocol variant testing (e.g., socks4 -> socks4a)
2. Multiple endpoint verification
3. Auto-fallback between protocol variants
4. Best latency recording per protocol
- **Timeout**: 5 seconds per connection attempt
## 🌟 Key Advantages
- Protocol variant auto-detection
- China-specific site testing (Baidu/Bing CN)
- User-agent spoofing prevention
- Connection error resilience
## 🤝 Contribution
PRs welcome for:
- Improved protocol handling
- Additional test targets
- Performance optimizations
## 📜 License
MIT © 2025 CNMengHan