{"id":39881979,"url":"https://github.com/wyattowalsh/proxywhirl","last_synced_at":"2026-03-03T09:09:15.303Z","repository":{"id":310851629,"uuid":"976492927","full_name":"wyattowalsh/proxywhirl","owner":"wyattowalsh","description":"rotating proxy system","archived":false,"fork":false,"pushed_at":"2026-03-02T14:42:25.000Z","size":1183227,"stargazers_count":0,"open_issues_count":8,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2026-03-02T16:32:08.088Z","etag":null,"topics":["data","data-extraction","dataextraction","proxy","proxy-checker","proxy-list","proxy-scraper","proxy-server","proxypool","python","python3","rotating-proxy","sqlite","sqlite3","web-data-extraction"],"latest_commit_sha":null,"homepage":"https://proxywhirl.com","language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/wyattowalsh.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":"AGENTS.md","dco":null,"cla":null},"funding":{"github":["wyattowalsh"],"patreon":null,"open_collective":null,"ko_fi":null,"tidelift":null,"community_bridge":null,"liberapay":null,"issuehunt":null,"lfx_crowdfunding":null,"polar":null,"buy_me_a_coffee":null,"thanks_dev":null,"custom":null}},"created_at":"2025-05-02T07:50:00.000Z","updated_at":"2026-03-02T14:42:31.000Z","dependencies_parsed_at":"2025-08-20T17:23:04.706Z","dependency_job_id":"6b6ad708-3893-4f89-be33-44bd1572f416","html_url":"https://github.com/wyattowalsh/proxywhirl","commit_stats":null,"previous_names":["wyattowalsh/proxywhirl"],"tags_count":6,"template":false,"template_full_name":null,"purl":"pkg:github/wyattowalsh/proxywhirl","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wyattowalsh%2Fproxywhirl","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wyattowalsh%2Fproxywhirl/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wyattowalsh%2Fproxywhirl/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wyattowalsh%2Fproxywhirl/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/wyattowalsh","download_url":"https://codeload.github.com/wyattowalsh/proxywhirl/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wyattowalsh%2Fproxywhirl/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30013921,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-02T17:00:27.440Z","status":"ssl_error","status_checked_at":"2026-03-02T17:00:03.402Z","response_time":60,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data","data-extraction","dataextraction","proxy","proxy-checker","proxy-list","proxy-scraper","proxy-server","proxypool","python","python3","rotating-proxy","sqlite","sqlite3","web-data-extraction"],"created_at":"2026-01-18T14:31:52.377Z","updated_at":"2026-03-03T09:09:15.297Z","avatar_url":"https://github.com/wyattowalsh.png","language":"HTML","funding_links":["https://github.com/sponsors/wyattowalsh"],"categories":[],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n\n\u003c!-- Hero --\u003e\n\u003cpicture\u003e\n  \u003csource media=\"(prefers-color-scheme: dark)\" srcset=\"docs/assets/whirl.svg\"\u003e\n  \u003csource media=\"(prefers-color-scheme: light)\" srcset=\"docs/assets/whirl.svg\"\u003e\n  \u003cimg src=\"docs/assets/whirl.svg\" alt=\"ProxyWhirl\" width=\"700\"/\u003e\n\u003c/picture\u003e\n\n\u003cbr/\u003e\u003cbr/\u003e\n\n\u003c!-- One-liner --\u003e\n\u003ch3\u003e🌀 Intelligent proxy rotation that just works\u003c/h3\u003e\n\n\u003cbr/\u003e\n\n\u003c!-- Badges row 1: Key stats --\u003e\n[![PyPI](https://img.shields.io/pypi/v/proxywhirl?style=for-the-badge\u0026logo=pypi\u0026logoColor=white\u0026color=3b82f6\u0026labelColor=1e293b)](https://pypi.org/project/proxywhirl/)\n\u0026nbsp;\n[![Downloads](https://img.shields.io/pypi/dm/proxywhirl?style=for-the-badge\u0026logo=download\u0026logoColor=white\u0026color=22c55e\u0026labelColor=1e293b)](https://pypi.org/project/proxywhirl/)\n\u0026nbsp;\n[![Python](https://img.shields.io/badge/3.9+-a855f7?style=for-the-badge\u0026logo=python\u0026logoColor=white\u0026labelColor=1e293b)](https://python.org)\n\n\u003c!-- Live stats dashboard --\u003e\n\u003cbr/\u003e\n\u003cimg src=\"docs/assets/stats-animated.svg\" alt=\"Stats\" width=\"700\"/\u003e\n\u003cbr/\u003e\u003cbr/\u003e\n\n\u003c!-- Navigation pills --\u003e\n[\u003ckbd\u003e \u003cbr\u003e 📖 Docs \u003cbr\u003e \u003c/kbd\u003e](https://www.proxywhirl.com/docs/)\u0026nbsp;\u0026nbsp;\n[\u003ckbd\u003e \u003cbr\u003e 🚀 Examples \u003cbr\u003e \u003c/kbd\u003e](examples.ipynb)\u0026nbsp;\u0026nbsp;\n[\u003ckbd\u003e \u003cbr\u003e 💬 Discussions \u003cbr\u003e \u003c/kbd\u003e](https://github.com/wyattowalsh/proxywhirl/discussions)\n\n\u003c/div\u003e\n\n\u003cbr/\u003e\n\n---\n\n\u003cbr/\u003e\n\n## ⚡ 30-Second Setup\n\n```bash\npip install proxywhirl\n```\n\n```python\nfrom proxywhirl import ProxyWhirl\n\nrotator = ProxyWhirl(proxies=[\"http://p1:8080\", \"http://p2:8080\"])\nresponse = rotator.get(\"https://api.example.com/data\")\n# Dead proxies auto-ejected ✓ | Slow ones deprioritized ✓ | Fast ones favored ✓\n```\n\n\u003cbr/\u003e\n\n---\n\n\u003cbr/\u003e\n\n\u003cdiv align=\"center\"\u003e\n\n## 🎯 Why ProxyWhirl?\n\n\u003ctable\u003e\n\u003ctr\u003e\n\u003ctd align=\"center\" width=\"25%\"\u003e\n\u003cbr/\u003e\n\u003cimg src=\"https://api.iconify.design/carbon:rotate-360.svg?color=%2306b6d4\" width=\"48\"/\u003e\n\u003cbr/\u003e\u003cbr/\u003e\n\u003cstrong\u003e9 Strategies\u003c/strong\u003e\n\u003cbr/\u003e\n\u003csub\u003eRound-robin, weighted, geo-targeted, performance-based \u0026 more\u003c/sub\u003e\n\u003cbr/\u003e\u003cbr/\u003e\n\u003c/td\u003e\n\u003ctd align=\"center\" width=\"25%\"\u003e\n\u003cbr/\u003e\n\u003cimg src=\"https://api.iconify.design/carbon:cloud-download.svg?color=%238b5cf6\" width=\"48\"/\u003e\n\u003cbr/\u003e\u003cbr/\u003e\n\u003cstrong\u003e114 Sources\u003c/strong\u003e\n\u003cbr/\u003e\n\u003csub\u003eAuto-fetch from built-in providers with validation\u003c/sub\u003e\n\u003cbr/\u003e\u003cbr/\u003e\n\u003c/td\u003e\n\u003ctd align=\"center\" width=\"25%\"\u003e\n\u003cbr/\u003e\n\u003cimg src=\"https://api.iconify.design/carbon:health-cross.svg?color=%2322c55e\" width=\"48\"/\u003e\n\u003cbr/\u003e\u003cbr/\u003e\n\u003cstrong\u003eSelf-Healing\u003c/strong\u003e\n\u003cbr/\u003e\n\u003csub\u003eAuto-eject dead proxies, circuit breakers, recovery\u003c/sub\u003e\n\u003cbr/\u003e\u003cbr/\u003e\n\u003c/td\u003e\n\u003ctd align=\"center\" width=\"25%\"\u003e\n\u003cbr/\u003e\n\u003cimg src=\"https://api.iconify.design/carbon:lightning.svg?color=%23f97316\" width=\"48\"/\u003e\n\u003cbr/\u003e\u003cbr/\u003e\n\u003cstrong\u003eBlazing Fast\u003c/strong\u003e\n\u003cbr/\u003e\n\u003csub\u003eAsync-first, \u0026lt;3μs selection, zero blocking\u003c/sub\u003e\n\u003cbr/\u003e\u003cbr/\u003e\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\n\u003c/div\u003e\n\n\u003cbr/\u003e\n\n---\n\n\u003cbr/\u003e\n\n## 🔄 Rotation Strategies\n\n```python\n# Switch strategies on the fly\nrotator = ProxyWhirl(strategy=\"performance-based\")\nrotator.set_strategy(\"geo-targeted\", preferences={\"US\": [...], \"EU\": [...]})\n```\n\n| Strategy | Best For |\n|:---------|:---------|\n| `round-robin` | Even distribution |\n| `random` | Unpredictable patterns |\n| `weighted` | Favor reliable proxies |\n| `least-used` | Even load balance |\n| `performance-based` | Lowest latency |\n| `geo-targeted` | Regional routing |\n| `session-persistence` | Sticky sessions |\n| `cost-aware` | Budget optimization |\n| `composite` | Custom pipelines |\n\n\u003cbr/\u003e\n\n---\n\n\u003cbr/\u003e\n\n## 🎣 Auto-Fetch Proxies\n\n```python\nfrom proxywhirl import ProxyFetcher\n\n# Grab 300+ validated proxies in seconds\nproxies = await ProxyFetcher().fetch_all(validate=True)\n```\n\n\u003cbr/\u003e\n\n---\n\n\u003cbr/\u003e\n\n## 🖥️ Multiple Interfaces\n\n\u003ctable\u003e\n\u003ctr\u003e\n\u003ctd width=\"33%\"\u003e\n\n**Python API**\n```python\nrotator.get(url)\nrotator.post(url, json=data)\nasync with AsyncProxyWhirl() as async_rotator:\n    await async_rotator.get(url)\n```\n\n\u003c/td\u003e\n\u003ctd width=\"33%\"\u003e\n\n**CLI**\n```bash\nproxywhirl fetch\nproxywhirl pool list\nproxywhirl health\n```\n\n\u003c/td\u003e\n\u003ctd width=\"33%\"\u003e\n\n**REST API**\n```bash\ndocker-compose up -d\ncurl localhost:8000/api/v1/proxies\n```\n\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\n\u003cbr/\u003e\n\n---\n\n\u003cbr/\u003e\n\n\u003cdiv align=\"center\"\u003e\n\n## 📚 Learn More\n\n[\u003ckbd\u003e \u003cbr\u003e \u0026nbsp;\u0026nbsp;📖 Full Documentation\u0026nbsp;\u0026nbsp; \u003cbr\u003e \u003c/kbd\u003e](https://www.proxywhirl.com/docs/)\u0026nbsp;\u0026nbsp;\u0026nbsp;\n[\u003ckbd\u003e \u003cbr\u003e \u0026nbsp;\u0026nbsp;🎯 Strategy Guide\u0026nbsp;\u0026nbsp; \u003cbr\u003e \u003c/kbd\u003e](docs/source/guides/advanced-strategies.md)\u0026nbsp;\u0026nbsp;\u0026nbsp;\n[\u003ckbd\u003e \u003cbr\u003e \u0026nbsp;\u0026nbsp;🤖 MCP Server\u0026nbsp;\u0026nbsp; \u003cbr\u003e \u003c/kbd\u003e](docs/source/guides/mcp-server.md)\u0026nbsp;\u0026nbsp;\u0026nbsp;\n[\u003ckbd\u003e \u003cbr\u003e \u0026nbsp;\u0026nbsp;📓 Examples\u0026nbsp;\u0026nbsp; \u003cbr\u003e \u003c/kbd\u003e](examples.ipynb)\n\n\u003cbr/\u003e\u003cbr/\u003e\n\n---\n\n\u003cbr/\u003e\n\n[![Star History](https://api.star-history.com/svg?repos=wyattowalsh/proxywhirl\u0026type=Date\u0026theme=dark)](https://star-history.com/#wyattowalsh/proxywhirl\u0026Date)\n\n\u003cbr/\u003e\n\n**[GitHub](https://github.com/wyattowalsh/proxywhirl)** · **[Issues](https://github.com/wyattowalsh/proxywhirl/issues)** · **[MIT License](LICENSE)**\n\n\u003csub\u003eBuilt with ❤️ for ethical web automation\u003c/sub\u003e\n\n\u003c/div\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwyattowalsh%2Fproxywhirl","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fwyattowalsh%2Fproxywhirl","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwyattowalsh%2Fproxywhirl/lists"}