https://github.com/monosans/proxy-scraper-checker
HTTP, SOCKS4, SOCKS5 proxies scraper and checker with rich functionality.
https://github.com/monosans/proxy-scraper-checker
list proxy-checker proxyscrape proxyscraper
Last synced: 5 months ago
JSON representation
HTTP, SOCKS4, SOCKS5 proxies scraper and checker with rich functionality.
- Host: GitHub
- URL: https://github.com/monosans/proxy-scraper-checker
- Owner: monosans
- License: mit
- Created: 2021-04-29T20:04:52.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2025-05-14T11:52:18.000Z (5 months ago)
- Last Synced: 2025-05-14T12:54:28.586Z (5 months ago)
- Topics: list, proxy-checker, proxyscrape, proxyscraper
- Language: Rust
- Homepage:
- Size: 2.53 MB
- Stars: 1,058
- Watchers: 23
- Forks: 249
- Open Issues: 5
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# proxy-scraper-checker
[](https://github.com/monosans/proxy-scraper-checker/actions/workflows/ci.yml)
HTTP, SOCKS4, SOCKS5 proxies scraper and checker.
- Written in Rust.
- Can determine if the proxy is anonymous.
- Supports determining the geolocation of the proxy exit node.
- Can sort proxies by speed.
- Uses regex to find proxies of format `protocol://username:password@host:port` on a web page or in a local file, allowing proxies to be extracted even from json without code changes.
- Supports proxies with authentication.
- It is possible to specify the URL to which to send a request to check the proxy.
- Supports saving to plain text and json.
- Asynchronous.
You can get proxies obtained using this project in [monosans/proxy-list](https://github.com/monosans/proxy-list).
## Installation and usage
### Binary
> [!NOTE]
> There is a separate section for Termux.
1. Download the archive for your platform from [nightly.link](https://nightly.link/monosans/proxy-scraper-checker/workflows/ci/main?preview). If you are not sure which archive you need, use [the table](https://doc.rust-lang.org/beta/rustc/platform-support.html).
1. Unpack the archive into a separate folder.
1. Edit `config.toml` to your preference.
1. Run the executable.
### Docker
> [!NOTE]
> Only a simple user interface in the form of logs is implemented for Docker.
1. [Install `Docker Compose`](https://docs.docker.com/compose/install/).
1. Download the archive for your platform from [nightly.link](https://nightly.link/monosans/proxy-scraper-checker/workflows/ci/main?preview). Look for artifacts named `proxy-scraper-checker-docker`.
1. Unpack the archive into a separate folder.
1. Edit `config.toml` to your preference.
1. Run the following commands:
Windows:
```bash
docker compose build
docker compose up --no-log-prefix --remove-orphans
```
Linux/macOS:
```bash
docker compose build --build-arg UID=$(id -u) --build-arg GID=$(id -g)
docker compose up --no-log-prefix --remove-orphans
```
### Termux
1. Download Termux from [F-Droid](https://f-droid.org/en/packages/com.termux/). [Don't download it from Google Play](https://github.com/termux/termux-app#google-play-store-experimental-branch).
1. Run the following command. It will automatically download and install `proxy-scraper-checker`.
```bash
bash <(curl -fsSL 'https://raw.githubusercontent.com/monosans/proxy-scraper-checker/main/termux.sh')
```
1. Edit `~/proxy-scraper-checker/config.toml` to your preference using a text editor (vim/nano).
1. To run `proxy-scraper-checker` use the following command:
```bash
cd ~/proxy-scraper-checker && ./proxy-scraper-checker
```
## License
[MIT](LICENSE)
This product includes GeoLite2 Data created by MaxMind, available from .