https://github.com/markgacoka/selenium-proxy-rotator

A python wrapper around selenium that makes web automation anonymous through proxy rotation
https://github.com/markgacoka/selenium-proxy-rotator

proxy proxy-rotator selenium selenium-python selenium-webdriver web-automation

Last synced: about 1 month ago
JSON representation

A python wrapper around selenium that makes web automation anonymous through proxy rotation

• Host: GitHub
• URL: https://github.com/markgacoka/selenium-proxy-rotator
• Owner: markgacoka
• License: gpl-3.0
• Created: 2020-12-12T12:52:36.000Z (about 4 years ago)
• Default Branch: main
• Last Pushed: 2021-12-30T00:24:14.000Z (about 3 years ago)
• Last Synced: 2024-05-01T06:33:02.225Z (9 months ago)
• Topics: proxy, proxy-rotator, selenium, selenium-python, selenium-webdriver, web-automation
• Language: Python
• Homepage:
• Size: 5.74 MB
• Stars: 38
• Watchers: 4
• Forks: 16
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-hacking-lists - markgacoka/selenium-proxy-rotator - A python wrapper around selenium that makes web automation anonymous through proxy rotation (Python)

README

        
# Selenium proxy-rotator

A python wrapper around selenium that makes web automation anonymous through elite proxy rotation.

## Features

- Supports incognito

- Random MAC address

- Random user agent

- Rotating proxy support for IP change

- Browser geolocation rotation (matches IP from proxy)

## How it works

The algorithm changes the MAC address of your computer. It then initializes the random user agent and proxy IP which is scraped from 3 different elite proxy sources. A Selenium webdriver session is then started where you can automate your web scraping or surfing anonymously.

## Usage

On main.py

```python

    #Open url

    open_url(chromedriver, url)

    time.sleep(5)

    #### Add your own code here.

    # Get session

    print('[+] Session ID: ' + chromedriver.session_id)

    print('[+] Deleting all cookies...')

    chromedriver.delete_all_cookies()

    chromedriver.quit()

```

### Instructions

- If you get an error based on the interface, type `ifconfig` or `ipconfig` on cli and change the value.

### Chromedriver 

- Chromium version: 87.0.4280.88

- Tested on Ubuntu 20.04 (Focal Fossa)

## TODO

- [x] Scrape elite proxies.

- [ ] Add debug mode for issue handling.

- [ ] Confirm proxies work.

- [x] Proxy rotation for IP change.

- [x] Geological location change in relation to IP address.

- [x] Refreshing cookies and chache 

- [ ] Add config file for entering the interface name and browser size.

- [ ] Server/continent proxy location support

Thank you for checking out this repo! 

If you found this helpful, feel free to star my work and tell me some of the creative applications you came up with. However, be minful of where and how you scrape. Make sure to stay within the confines of the law to not piss people off!