{"id":13376102,"url":"https://github.com/liuslnlp/ProxyPool","last_synced_at":"2025-03-13T01:31:53.359Z","repository":{"id":41199508,"uuid":"75586784","full_name":"liuslnlp/ProxyPool","owner":"liuslnlp","description":"跨语言IP代理池，Python实现。","archived":false,"fork":false,"pushed_at":"2018-04-06T09:59:25.000Z","size":821,"stargazers_count":355,"open_issues_count":8,"forks_count":121,"subscribers_count":20,"default_branch":"master","last_synced_at":"2024-07-30T05:18:16.395Z","etag":null,"topics":["ip-python","proxy","proxypool"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/liuslnlp.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-12-05T03:54:14.000Z","updated_at":"2024-07-04T00:34:35.000Z","dependencies_parsed_at":"2022-09-22T21:11:21.753Z","dependency_job_id":null,"html_url":"https://github.com/liuslnlp/ProxyPool","commit_stats":null,"previous_names":["wisedoge/proxypool"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/liuslnlp%2FProxyPool","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/liuslnlp%2FProxyPool/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/liuslnlp%2FProxyPool/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/liuslnlp%2FProxyPool/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/liuslnlp","download_url":"https://codeload.github.com/liuslnlp/ProxyPool/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243125540,"owners_count":20240276,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ip-python","proxy","proxypool"],"created_at":"2024-07-30T05:02:23.978Z","updated_at":"2025-03-13T01:31:53.342Z","avatar_url":"https://github.com/liuslnlp.png","language":"Python","funding_links":[],"categories":["\u003ca id=\"d03d494700077f6a65092985c06bf8e8\"\u003e\u003c/a\u003e工具"],"sub_categories":["\u003ca id=\"b2241c68725526c88e69f1d71405c6b2\"\u003e\u003c/a\u003e代理爬取\u0026\u0026代理池"],"readme":"# ProxyPool\n[![Build Status](https://travis-ci.org/WiseDoge/ProxyPool.svg?branch=master)](https://travis-ci.org/WiseDoge/ProxyPool)   \n跨语言高性能IP代理池，Python实现。    \n\n注意：请运行程序前先更新一下抓取代理的爬虫。\n\n## 运行环境\n\n* Python 3.6\n\n  (请务必保证Python的版本在3.6以上，否则异步检验无法使用。)\n\n* Redis \n\n  Redis官网并没有提供Windows的安装版，Windows用户可以[点击此处](http://pan.baidu.com/s/1kVe6lc7)下载一个我自己编译的二进制版本(3.2版本2.7MB，VS 2015编译)。\n\n## 安装\n\n### ① 直接使用\n\n#### 安装依赖\n\n`$ pip install -r requirements.txt`\n\n*Windows用户如果无法安装lxml库请[点击这里](http://www.lfd.uci.edu/~gohlke/pythonlibs/)*。\n\n#### 打开代理池和API\n\n`$ cd proxypool`\n\n`$ python3 run.py `\n\n### ② 安装使用\n\n#### 安装\n\n`$ cd proxypool`\n\n`$ python setup.py install`\n\n#### 打开代理池和API\n\n`$ proxypool_run`\n\n\n## 使用API获取代理\n\n访问`http://127.0.0.1:5000/`进入主页，如果显示'Welcome'，证明成功启动。\n\n![pic](docs/1.png)\n\n访问`http://127.0.0.1:5000/get`可以获取一个可用代理。  \n\n![pic](docs/3.png)\n\n访问`http://127.0.0.1:5000/count`可以获取代理池中可用代理的数量。  \n\n![pic](docs/2.png)\n\n也可以在程序代码中用相应的语言获取，例如:\n\n```\nimport requests\nfrom bs4 import BeautifulSoup\nimport lxml\n\ndef get_proxy():\n    r = requests.get('http://127.0.0.1:5000/get')\n    proxy = BeautifulSoup(r.text, \"lxml\").get_text()\n    return proxy\n```\n## 文件结构\n![picture](docs/5.png)\n![picture](docs/4.png)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fliuslnlp%2FProxyPool","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fliuslnlp%2FProxyPool","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fliuslnlp%2FProxyPool/lists"}