{"id":19035242,"url":"https://github.com/omkarcloud/botasaurus-proxy-authentication","last_synced_at":"2025-06-10T15:04:12.604Z","repository":{"id":213831813,"uuid":"734971251","full_name":"omkarcloud/botasaurus-proxy-authentication","owner":"omkarcloud","description":"Proxy Server with support for SSL, proxy authentication and upstream proxy.","archived":false,"fork":false,"pushed_at":"2024-05-05T09:39:40.000Z","size":12,"stargazers_count":12,"open_issues_count":0,"forks_count":5,"subscribers_count":0,"default_branch":"master","last_synced_at":"2025-05-28T23:49:00.655Z","etag":null,"topics":["anonymity","anonymous","http-proxy","privacy","proxies","proxy","proxy-authentication","proxy-checker","proxy-list","proxy-server","proxypool","socks","ssl-proxy"],"latest_commit_sha":null,"homepage":"https://www.omkar.cloud/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/omkarcloud.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null},"funding":{"github":["Chetan11-Dev"],"patreon":null,"open_collective":null,"ko_fi":null,"tidelift":null,"community_bridge":null,"liberapay":null,"issuehunt":null,"otechie":null,"lfx_crowdfunding":null,"custom":null}},"created_at":"2023-12-23T07:43:23.000Z","updated_at":"2025-04-02T23:20:16.000Z","dependencies_parsed_at":"2025-04-23T18:02:27.114Z","dependency_job_id":"6823092b-fbae-4d4a-9385-d2df4ad8ecdb","html_url":"https://github.com/omkarcloud/botasaurus-proxy-authentication","commit_stats":null,"previous_names":["omkarcloud/botasaurus-proxy-authentication"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/omkarcloud%2Fbotasaurus-proxy-authentication","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/omkarcloud%2Fbotasaurus-proxy-authentication/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/omkarcloud%2Fbotasaurus-proxy-authentication/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/omkarcloud%2Fbotasaurus-proxy-authentication/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/omkarcloud","download_url":"https://codeload.github.com/omkarcloud/botasaurus-proxy-authentication/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/omkarcloud%2Fbotasaurus-proxy-authentication/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":257861414,"owners_count":22615444,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["anonymity","anonymous","http-proxy","privacy","proxies","proxy","proxy-authentication","proxy-checker","proxy-list","proxy-server","proxypool","socks","ssl-proxy"],"created_at":"2024-11-08T21:49:45.783Z","updated_at":"2025-06-10T15:04:12.584Z","avatar_url":"https://github.com/omkarcloud.png","language":"Python","readme":"# Botasaurus Proxy Authentication\n\nBotasaurus Proxy Authentication provides SSL support for authenticated proxies. \n\nProxy providers like BrightData, IPRoyal, and others typically provide authenticated proxies in the format \"http://username:password@proxy-provider-domain:port\". For example, \"http://greyninja:awesomepassword@geo.iproyal.com:12321\".\n\nHowever, if you use an authenticated proxy with a library like seleniumwire to scrape a Cloudflare protected website like G2.com, you will surely be blocked because you are using a non-SSL connection. \n\nTo verify this, run the following code:\n\nFirst, install the necessary packages:\n```bash \npython -m pip install selenium_wire chromedriver_autoinstaller\n```\n\nThen, execute this Python script:\n```python\nfrom seleniumwire import webdriver\nfrom chromedriver_autoinstaller import install\n\n# Define the proxy\nproxy_options = {\n    'proxy': {\n        'http': 'http://username:password@proxy-provider-domain:port', # TODO: Replace with your own proxy\n        'https': 'http://username:password@proxy-provider-domain:port', # TODO: Replace with your own proxy\n    }\n}\n\n# Install and set up the driver\ndriver_path = install()\ndriver = webdriver.Chrome(driver_path, seleniumwire_options=proxy_options)\n\n# Navigate to the desired URL\ndriver.get(\"https://ipinfo.io/\")\n\n# Prompt for user input\ninput(\"Press Enter to exit...\")\n\n# Clean up\ndriver.quit()\n```\n\nYou will definetely encounter a block by Cloudflare:\n\n![blocked](https://raw.githubusercontent.com/omkarcloud/botasaurus/master/images/seleniumwireblocked.png)\n\nHowever, using proxies with botasaurus_proxy_authentication prevents this issue. See the difference by running the following code:\n\nFirst, install the necessary packages:\n```bash \npython -m pip install botasaurus\n```\n\nThen, execute this Python script:\n\n```python\nfrom botasaurus import *\n\n@browser(proxy=\"http://username:password@proxy-provider-domain:port\") # TODO: Replace with your own proxy \ndef scrape_heading_task(driver: AntiDetectDriver, data):\n    driver.get(\"https://ipinfo.io/\")\n    driver.prompt()\nscrape_heading_task()    \n```  \n\nResult: \n![not blocked](https://raw.githubusercontent.com/omkarcloud/botasaurus/master/images/botasurussuccesspage.png)\n\nNOTE: To run the code above, you will need Node.js installed.\n\n\n## Usage with Botasaurus \n\n```python\nfrom botasaurus import *\n\n@browser(proxy=\"http://username:password@proxy-provider-domain:port\") # TODO: Replace with your own proxy \ndef visit_ipinfo(driver: AntiDetectDriver, data):\n    driver.get(\"https://ipinfo.io/\")\n    driver.prompt()\nvisit_ipinfo()    \n```  \n\n## Usage with Selenium \n\n```python\nfrom selenium import webdriver\nfrom selenium.webdriver.chrome.options import Options\nfrom chromedriver_autoinstaller import install\nfrom botasaurus_proxy_authentication import add_proxy_options\n\n# Define the proxy settings\nproxy = 'http://username:password@proxy-provider-domain:port'  # TODO: Replace with your own proxy\n\n# Set Chrome options\nchrome_options = Options()\nadd_proxy_options(chrome_options, proxy)\n\n# Install and set up the driver\ndriver_path = install()\ndriver = webdriver.Chrome(driver_path, options=chrome_options)\n\n# Navigate to the desired URL\ndriver.get(\"https://ipinfo.io/\")\n\n# Prompt for user input\ninput(\"Press Enter to exit...\")\n\n# Clean up\ndriver.quit()\n```  \n\n## Botasaurus\n\nWe encourage you to learn about [Botasaurus](https://github.com/omkarcloud/botasaurus). The All-in-One Web Scraping Framework with Anti-Detection, Parallelization, Asynchronous, and Caching Superpowers.\n\n## Thanks\n\n- Kudos to the Apify Team for creating `proxy-chain` library. The implementation of SSL-based Proxy Authentication wouldn't be possible without their groundbreaking work on `proxy-chain`.\n\n## Love It? [Star It! ⭐](https://github.com/omkarcloud/botasaurus)\n\nBecome one of our amazing stargazers by giving us a star ⭐ on GitHub!\n\nIt's just one click, but it means the world to me.\n\n[![Stargazers for @omkarcloud/botasaurus-proxy-authentication](https://bytecrank.com/nastyox/reporoster/php/stargazersSVG.php?user=omkarcloud\u0026repo=botasaurus-proxy-authentication)](https://github.com/omkarcloud/botasaurus-proxy-authentication/stargazers)\n\n## Made with ❤️ in Bharat 🇮🇳 - Vande Mataram\n","funding_links":["https://github.com/sponsors/Chetan11-Dev"],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fomkarcloud%2Fbotasaurus-proxy-authentication","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fomkarcloud%2Fbotasaurus-proxy-authentication","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fomkarcloud%2Fbotasaurus-proxy-authentication/lists"}