{"id":13585501,"url":"https://github.com/monosans/proxy-scraper-checker","last_synced_at":"2025-05-14T19:10:27.410Z","repository":{"id":37391757,"uuid":"362934123","full_name":"monosans/proxy-scraper-checker","owner":"monosans","description":"HTTP, SOCKS4, SOCKS5 proxies scraper and checker with rich functionality.","archived":false,"fork":false,"pushed_at":"2025-05-14T11:52:18.000Z","size":2652,"stargazers_count":1058,"open_issues_count":5,"forks_count":249,"subscribers_count":23,"default_branch":"main","last_synced_at":"2025-05-14T12:54:28.586Z","etag":null,"topics":["list","proxy-checker","proxyscrape","proxyscraper"],"latest_commit_sha":null,"homepage":"","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/monosans.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2021-04-29T20:04:52.000Z","updated_at":"2025-05-14T11:52:22.000Z","dependencies_parsed_at":"2023-10-17T10:15:18.585Z","dependency_job_id":"94e1e805-980e-4b43-9ab1-e081aabc1ffc","html_url":"https://github.com/monosans/proxy-scraper-checker","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/monosans%2Fproxy-scraper-checker","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/monosans%2Fproxy-scraper-checker/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/monosans%2Fproxy-scraper-checker/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/monosans%2Fproxy-scraper-checker/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/monosans","download_url":"https://codeload.github.com/monosans/proxy-scraper-checker/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254209859,"owners_count":22032897,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["list","proxy-checker","proxyscrape","proxyscraper"],"created_at":"2024-08-01T15:04:58.832Z","updated_at":"2025-05-14T19:10:25.685Z","avatar_url":"https://github.com/monosans.png","language":"Rust","funding_links":[],"categories":["Python","Rust"],"sub_categories":[],"readme":"# proxy-scraper-checker\n\n[![CI](https://github.com/monosans/proxy-scraper-checker/actions/workflows/ci.yml/badge.svg)](https://github.com/monosans/proxy-scraper-checker/actions/workflows/ci.yml)\n\n![Screenshot](https://github.com/user-attachments/assets/0ac37021-d11c-4f68-b80d-bafdbaeb00bb)\n\nHTTP, SOCKS4, SOCKS5 proxies scraper and checker.\n\n- Written in Rust.\n- Can determine if the proxy is anonymous.\n- Supports determining the geolocation of the proxy exit node.\n- Can sort proxies by speed.\n- Uses regex to find proxies of format `protocol://username:password@host:port` on a web page or in a local file, allowing proxies to be extracted even from json without code changes.\n- Supports proxies with authentication.\n- It is possible to specify the URL to which to send a request to check the proxy.\n- Supports saving to plain text and json.\n- Asynchronous.\n\nYou can get proxies obtained using this project in [monosans/proxy-list](https://github.com/monosans/proxy-list).\n\n## Installation and usage\n\n### Binary\n\n\u003e [!NOTE]\n\u003e There is a separate section for Termux.\n\n1. Download the archive for your platform from [nightly.link](https://nightly.link/monosans/proxy-scraper-checker/workflows/ci/main?preview). If you are not sure which archive you need, use [the table](https://doc.rust-lang.org/beta/rustc/platform-support.html).\n1. Unpack the archive into a separate folder.\n1. Edit `config.toml` to your preference.\n1. Run the executable.\n\n### Docker\n\n\u003e [!NOTE]\n\u003e Only a simple user interface in the form of logs is implemented for Docker.\n\n1. [Install `Docker Compose`](https://docs.docker.com/compose/install/).\n1. Download the archive for your platform from [nightly.link](https://nightly.link/monosans/proxy-scraper-checker/workflows/ci/main?preview). Look for artifacts named `proxy-scraper-checker-docker`.\n1. Unpack the archive into a separate folder.\n1. Edit `config.toml` to your preference.\n1. Run the following commands:\n\n   Windows:\n\n   ```bash\n   docker compose build\n   docker compose up --no-log-prefix --remove-orphans\n   ```\n\n   Linux/macOS:\n\n   ```bash\n   docker compose build --build-arg UID=$(id -u) --build-arg GID=$(id -g)\n   docker compose up --no-log-prefix --remove-orphans\n   ```\n\n### Termux\n\n1. Download Termux from [F-Droid](https://f-droid.org/en/packages/com.termux/). [Don't download it from Google Play](https://github.com/termux/termux-app#google-play-store-experimental-branch).\n1. Run the following command. It will automatically download and install `proxy-scraper-checker`.\n\n   ```bash\n   bash \u003c(curl -fsSL 'https://raw.githubusercontent.com/monosans/proxy-scraper-checker/main/termux.sh')\n   ```\n\n1. Edit `~/proxy-scraper-checker/config.toml` to your preference using a text editor (vim/nano).\n1. To run `proxy-scraper-checker` use the following command:\n   ```bash\n   cd ~/proxy-scraper-checker \u0026\u0026 ./proxy-scraper-checker\n   ```\n\n## License\n\n[MIT](LICENSE)\n\nThis product includes GeoLite2 Data created by MaxMind, available from \u003chttps://www.maxmind.com\u003e.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmonosans%2Fproxy-scraper-checker","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmonosans%2Fproxy-scraper-checker","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmonosans%2Fproxy-scraper-checker/lists"}