Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/markgacoka/selenium-proxy-rotator

A python wrapper around selenium that makes web automation anonymous through proxy rotation
https://github.com/markgacoka/selenium-proxy-rotator

proxy proxy-rotator selenium selenium-python selenium-webdriver web-automation

Last synced: about 1 month ago
JSON representation

A python wrapper around selenium that makes web automation anonymous through proxy rotation

Awesome Lists containing this project

README

        

# Selenium proxy-rotator
A python wrapper around selenium that makes web automation anonymous through elite proxy rotation.

## Features
- Supports incognito
- Random MAC address
- Random user agent
- Rotating proxy support for IP change
- Browser geolocation rotation (matches IP from proxy)

## How it works
The algorithm changes the MAC address of your computer. It then initializes the random user agent and proxy IP which is scraped from 3 different elite proxy sources. A Selenium webdriver session is then started where you can automate your web scraping or surfing anonymously.

## Usage
On main.py
```python
#Open url
open_url(chromedriver, url)
time.sleep(5)
#### Add your own code here.

# Get session
print('[+] Session ID: ' + chromedriver.session_id)
print('[+] Deleting all cookies...')
chromedriver.delete_all_cookies()
chromedriver.quit()
```
### Instructions
- If you get an error based on the interface, type `ifconfig` or `ipconfig` on cli and change the value.

### Chromedriver
- Chromium version: 87.0.4280.88
- Tested on Ubuntu 20.04 (Focal Fossa)

## TODO
- [x] Scrape elite proxies.
- [ ] Add debug mode for issue handling.
- [ ] Confirm proxies work.
- [x] Proxy rotation for IP change.
- [x] Geological location change in relation to IP address.
- [x] Refreshing cookies and chache
- [ ] Add config file for entering the interface name and browser size.
- [ ] Server/continent proxy location support

Thank you for checking out this repo!

If you found this helpful, feel free to star my work and tell me some of the creative applications you came up with. However, be minful of where and how you scrape. Make sure to stay within the confines of the law to not piss people off!