Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/amirvalhalla/proxyminer
ProxyMiner is a powerful tool designed to scrape and collect proxies from various websites. It automates the process of gathering fresh proxy lists and saves them to a file for easy access and use.
https://github.com/amirvalhalla/proxyminer
http-proxy httpproxy https-proxy httpsproxy proxy proxy-checker proxy-list proxy-scraper proxygrabber proxypool socks4 socks4-proxy socks5 socks5-proxy
Last synced: 8 days ago
JSON representation
ProxyMiner is a powerful tool designed to scrape and collect proxies from various websites. It automates the process of gathering fresh proxy lists and saves them to a file for easy access and use.
- Host: GitHub
- URL: https://github.com/amirvalhalla/proxyminer
- Owner: amirvalhalla
- License: mit
- Created: 2024-07-16T19:05:10.000Z (6 months ago)
- Default Branch: main
- Last Pushed: 2024-08-10T21:08:16.000Z (5 months ago)
- Last Synced: 2024-08-10T22:24:28.378Z (5 months ago)
- Topics: http-proxy, httpproxy, https-proxy, httpsproxy, proxy, proxy-checker, proxy-list, proxy-scraper, proxygrabber, proxypool, socks4, socks4-proxy, socks5, socks5-proxy
- Language: Python
- Homepage:
- Size: 38.1 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# ProxyMiner
[![Lint and format check](https://github.com/amirvalhalla/ProxyMiner/actions/workflows/lint.yml/badge.svg?branch=main)](https://github.com/amirvalhalla/ProxyMiner/actions/workflows/lint.yml)
[![codecov](https://codecov.io/gh/amirvalhalla/ProxyMiner/graph/badge.svg?token=38NATNYG0H)](https://codecov.io/gh/amirvalhalla/ProxyMiner)ProxyMiner is a powerful tool designed to scrape and collect proxies from various websites. It automates the process of gathering fresh proxy lists and saves them to a file for easy access and use.
## Features
- **Automated Scraping**: Continuously scrape multiple websites for the latest proxies.
- **Customizable Sources**: Easily add or remove proxy sources to tailor the scraping process to your needs.
- **Proxy Validation**: Ensure collected proxies are functional and reliable.
- **Output File**: Store the gathered proxies in a file, formatted for easy integration with other tools and applications.
- **Scheduling**: Schedule scraping tasks to run at specific intervals, ensuring your proxy list is always up-to-date.## Installation
Clone the repository and install the required dependencies:
```bash
git clone https://github.com/yourusername/ProxyMiner.git
cd ProxyMiner
pip install -r requirements.txt
```