https://github.com/peterdavehello/curl-with-random-proxy
Automatically select a working SOCKS5 proxy and use it with curl as a wrapper script
https://github.com/peterdavehello/curl-with-random-proxy
curl hacktoberfest proxy shell shell-script socks5 socks5-proxy
Last synced: about 2 months ago
JSON representation
Automatically select a working SOCKS5 proxy and use it with curl as a wrapper script
- Host: GitHub
- URL: https://github.com/peterdavehello/curl-with-random-proxy
- Owner: PeterDaveHello
- License: gpl-2.0
- Created: 2021-09-20T16:56:11.000Z (over 3 years ago)
- Default Branch: master
- Last Pushed: 2023-03-26T13:50:31.000Z (about 2 years ago)
- Last Synced: 2025-02-13T08:22:28.467Z (3 months ago)
- Topics: curl, hacktoberfest, proxy, shell, shell-script, socks5, socks5-proxy
- Language: Shell
- Homepage:
- Size: 11.7 KB
- Stars: 2
- Watchers: 3
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# curl-with-random-proxy
`curl-with-random-proxy` is a wrapper script for `curl`, designed to automatically select a working SOCKS5 proxy for each HTTP/HTTPS request. The script fetches a list of SOCKS5 proxies, tests their connectivity, and chooses a random working proxy to send the request. If a proxy is non-working, it will try the next one and remove the non-working proxy from the list, continuing the process until a working proxy is found or no more proxies are available in the list.
## Features
- Fetch SOCKS5 proxy list from a configurable source
- Test proxy connectivity before use
- Automatically try the next proxy and remove non-working proxies from the list
- Randomly select a working proxy for each request
- Customizable proxy timeout and list update interval
- Passes all command-line arguments to the underlying `curl` command
## Prerequisites
The script relies on the following command line tools, which are commonly available on most Linux systems:
- curl
- dos2unix
- date
- head
- mkdir
- mktemp
- mv
- stat
- tail
- wc
If any of these tools are missing, you can usually install them using your system's package manager (e.g., `apt`, `yum`, or `pacman`).
## Installation
1. Download the `curl-with-random-proxy` script.
2. Make the script executable with `chmod +x curl-with-random-proxy`.
3. Move the script to a directory in your `$PATH`, e.g., `sudo mv curl-with-random-proxy /usr/local/bin/`.
## Usage
Use the `curl-with-random-proxy` command instead of `curl`:
```sh
curl-with-random-proxy https://ipinfo.tw
```
The script accepts all command-line arguments that curl does, and passes them through to the underlying curl command.
## Customization
You can customize the following variables through environment variables to suit your needs:
- `SOCKS5_PROXY_LIST`: Path to the file containing the list of SOCKS5 proxies. By default, the script uses a file in the `~/.curl-with-random-proxy` directory.
- `SOCKS5_PROXY_SOURCE`: URL of the SOCKS5 proxy list source. Defaults to a GitHub project: [TheSpeedX/SOCKS-List](https://github.com/TheSpeedX/PROXY-List).
- `PROXY_TIMEOUT`: Timeout in seconds for testing proxy connectivity (default: `3`).
- `PROXY_LIST_TTL`: Time in seconds between updates of the proxy list (default: `10800`, i.e., 3 hours).
- `CURL_USER_AGENT`: User agent string for `curl` requests (default: a recent Firefox user agent).
## License
GPL-2.0 (GNU GENERAL PUBLIC LICENSE Version 2)