{"id":14978757,"url":"https://github.com/wkunzhi/python3-spider","last_synced_at":"2025-05-15T00:13:24.496Z","repository":{"id":37710600,"uuid":"177906941","full_name":"wkunzhi/Python3-Spider","owner":"wkunzhi","description":"Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️","archived":false,"fork":false,"pushed_at":"2023-11-03T03:54:41.000Z","size":43632,"stargazers_count":3189,"open_issues_count":9,"forks_count":1028,"subscribers_count":95,"default_branch":"master","last_synced_at":"2025-05-14T10:32:04.387Z","etag":null,"topics":["crawl","crawler","dianping","geek","meituan","pyppeteer","python","scrapy","scrapy-crawler","selenium","spider","splash","taobao"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/wkunzhi.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2019-03-27T02:52:43.000Z","updated_at":"2025-05-14T02:19:43.000Z","dependencies_parsed_at":"2024-01-13T14:42:30.347Z","dependency_job_id":"c4651d32-ef7d-4747-a91b-717ee6aad436","html_url":"https://github.com/wkunzhi/Python3-Spider","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wkunzhi%2FPython3-Spider","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wkunzhi%2FPython3-Spider/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wkunzhi%2FPython3-Spider/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wkunzhi%2FPython3-Spider/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/wkunzhi","download_url":"https://codeload.github.com/wkunzhi/Python3-Spider/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254249206,"owners_count":22039029,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawl","crawler","dianping","geek","meituan","pyppeteer","python","scrapy","scrapy-crawler","selenium","spider","splash","taobao"],"created_at":"2024-09-24T13:58:19.008Z","updated_at":"2025-05-15T00:13:24.428Z","avatar_url":"https://github.com/wkunzhi.png","language":"Python","readme":"# \u003cp align=\"center\"\u003ePython3 爬虫实战\u003c/p\u003e\n\n\u003cbr\u003e\n\u003cp align=\"center\"\u003e\n    \u003cimg src=\"https://zok-blog.oss-cn-hangzhou.aliyuncs.com/pythonlg.jpg\" \n        alt=\"python3 spider\"\u003e\n\u003c/p\u003e\n\n\u003cbr /\u003e\n\u003cp align=\"center\"\u003e\n    \u003ca href=\"#\"\u003e\u003cimg src=\"https://img.shields.io/badge/status-updating-brightgreen.svg\"\u003e\u003c/a\u003e\n    \u003ca href=\"https://www.python.org/downloads/\"\u003e\u003cimg src=\"https://zok-blog.oss-cn-hangzhou.aliyuncs.com/ico/python-3.7-green.svg\"\u003e\u003c/a\u003e\n    \u003ca href=\"https://github.com/wkunzhi/Python3-Spider/graphs/contributors\"\u003e\u003cimg src=\"https://img.shields.io/github/contributors/wkunzhi/Python3-Spider?color=blue\"\u003e\u003c/a\u003e\n    \u003ca href=\"#\"\u003e\u003cimg src=\"https://img.shields.io/badge/Branch-master-green.svg?longCache=true\" alt=\"Branch\"\u003e\u003c/a\u003e\n    \u003ca href=\"#\"\u003e\u003cimg src=\"https://img.shields.io/github/stars/wkunzhi/Python3-Spider.svg?label=Stars\u0026style=social\"\u003e\u003c/a\u003e\n    \u003ca href=\"#\"\u003e\u003cimg src=\"https://img.shields.io/github/forks/wkunzhi/Python3-Spider.svg?label=Forks\u0026style=social\"\u003e\u003c/a\u003e\n\n\u003c/p\u003e\n\u003cbr /\u003e\n\n\n## 简介\n包含几十个 python3 爬虫实战案例。如果喜欢请 star 与 fork，这是对我继续更新下去的最大支持\n\n\n| Author  | Zok |\n| --- | --- |\n| Email | 362416272@qq.com |\n| 博客 | https://www.zhangkunzhi.com |\n\n\n## QQ讨论群 \n![](https://zok-blog.oss-cn-hangzhou.aliyuncs.com/2019/11/18/wx201911181627012x.png?x-oss-process=image/resize,h_150)\n\n\n\u003cbr /\u003e\n\n\n\n\n-------\n\n\n## Python 爬虫实战\n\n\n\u003e **字体加密**\n\n[天眼查](https://github.com/wkunzhi/Python3-Spider/tree/master/【天眼查】字体加密) | [大众点评](https://github.com/wkunzhi/Python3-Spider/tree/master/【大众点评】字体反爬、坐标反爬) | [谷雨](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【谷雨】数字解密) \n\n\u003e **验证码【仅作学术讨论】**\n\n[w3c-滑块](https://github.com/wkunzhi/Python3-Spider/tree/master/滑动验证码/【w3c】滑块验证) | [腾讯-滑块识别](https://github.com/wkunzhi/Python3-Spider/tree/master/滑动验证码/【腾讯】滑块验证/discriminate.py) ｜ [腾讯滑块拖动 selenium](https://github.com/wkunzhi/Python3-Spider/tree/master/滑动验证码/【腾讯】滑块验证/sel.py)\n\n\n\u003e **参数生成**  \n\n[拼多多](https://github.com/wkunzhi/Python3-Spider/tree/master/【拼多多】登陆参数生成) 失效！ | [小牛在线](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【小牛在线】登录参数生成) | [开鑫贷](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【开鑫贷】登陆参数生成) | [时光网](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【时光网】登陆参数生成) | [百度](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【百度】自动登录) | [公众号密码加密](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【微信】登录参数生成) | [移动](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【移动】登录参数生成) | [好莱客](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【好莱客】参数解析) | [青海移动](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【青海移动】登陆参数生成) | [新浪微博](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【新浪微博】密码解密) | [汽车之家](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【汽车之家】参数解密) | [steam](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【steam】登录) | [百度wap端sig生成](https://github.com/wkunzhi/Python3-Spider/tree/master/%E5%85%B6%E4%BB%96%E5%AE%9E%E6%88%98/%E3%80%90%E7%99%BE%E5%BA%A6%E3%80%91wap%E7%AB%AFsig%E7%94%9F%E6%88%90) \n\n\n\u003e **自动登录**\n\n[淘宝](https://github.com/wkunzhi/Python3-Spider/tree/master/【淘宝】自动登陆) | [5173平台](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【5173网】自动登录) | [房天下](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【房天下】自动登录) | [Glidesky](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【Glidedsky】自动登陆) | [中关村](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【中关村】自动登录) | [9377平台](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【9377网】自动登录) | [逗游](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【逗游】自动登录) | [GitHub](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【GitHub】自动登录) | [万创帮](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【万创帮】自动登录) | [空中网](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【空中网】自动登录) | [易通贷](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【易通贷】自动登录) | [DNS](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【DNS】自动登录) | [TCL金融](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【TCL金融】自动登录) | [国鑫所](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【国鑫所】自动登录)  | [满级网](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/满级网) | [试客联盟](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【试客联盟】自动登陆)  | [人人网](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【人人网】自动登录) | [豆瓣网](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【豆瓣】自动登录)  | [天翼](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【天翼】登录) \n\n\u003e **其他实战**  \n\n[文书网app查询接口](https://github.com/wkunzhi/Python3-Spider/tree/master/【文书】app查询接口) | [抖音无水印视频解析](https://github.com/wkunzhi/Python3-Spider/tree/master/【抖音】无水印视频解析) | [企业名片查询](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【企业名片】企业查询) ｜ [百度找回密码](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【百度】网页找回密码) ｜ [美女壁纸下载](https://github.com/wkunzhi/Python3-Spider/tree/master/【双色球】头奖分布) |  [美女壁纸下载](https://github.com/wkunzhi/Python3-Spider/tree/master/【壁纸】美女壁纸下载器) | [美团 解析与token生成](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【美团】数据解析、token生成) | [bilibili 视频下载](https://github.com/wkunzhi/Python3-Spider/tree/master/【bilibili】视频下载) | [51job 查岗位](https://github.com/wkunzhi/Python3-Spider/tree/master/【51Job】查岗位) | [百度 翻译](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【百度】翻译) | [美团 全国区域](https://github.com/wkunzhi/Python3-Spider/tree/master/各站案例/MeiTuanArea) |  [企业名片查询](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【餐饮】查询信息) | [金逸电影 注册](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【金逸电影】自动注册) | [Python加密库Demo](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【Python加密库】Demo) | [百度街拍图片下载](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【百度街拍】图片下载) ｜ [京东商品数据爬取](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【京东】商品数据爬取) | [房价获取](https://github.com/wkunzhi/Python3-Spider/tree/master/其他实战/【房价】房价获取)\n\n\n\n\n## 原创工具\n\u003e 此工具包在我另外一个项目中，欢迎 star\n\n- [【解密工具】可拓展式解密器](https://github.com/wkunzhi/SpiderUtilPackage/tree/master/Decode)\n- [【自动注册】验证短信接收器](https://github.com/wkunzhi/SpiderUtilPackage/tree/master/Register)\n- [【付费代理IP池】监控维护器](https://github.com/wkunzhi/SpiderUtilPackage/tree/master/Proxy)\n- [【cookies池】-美团cookies池](https://github.com/wkunzhi/SpiderUtilPackage/tree/master/Cookies)\n- [【跨数据库迁移器】-开发中](https://github.com/wkunzhi/SpiderUtilPackage/tree/master/DataMigration)\n- [【网络图片并发直传OSS】](https://github.com/wkunzhi/SpiderUtilPackage/tree/master/OSS)\n- [【JS攻防-自动生成encrypt结果】](https://github.com/wkunzhi/SpiderUtilPackage/tree/master/Jsencrypt)\n\n\n## 【推荐】爬虫练习网\n\u003e 一个很不错的爬虫练习题网，内涵十几个爬虫题目，由浅到深涵盖 **ip反爬、js反爬、字体反爬、验证码** 等题目。安利给大家，博主已撸完。\n\n- 登录网址 http://www.glidedsky.com/login\n- 题分排行榜 http://www.glidedsky.com/rank\n\n![](https://zok-blog.oss-cn-hangzhou.aliyuncs.com/images/%E7%88%AC%E8%99%AB%E9%A2%98%E8%AE%B0%E5%BD%95.png?x-oss-process=image/resize,w_400)\n\n----\n\n##淘宝：自动登录\n\n![自动登录](https://zok-blog.oss-cn-hangzhou.aliyuncs.com/tglog3.gif)\n\n- 打开 `auto_login_pyppeteer.py` Run 代码，输入淘宝账号、密码即可自动登录\n\n\n----\n\n\n##文书网app\n\n[《入门级安卓逆向 - 文书网app爬虫教程》](https://www.zhangkunzhi.com/index.php/archives/162/)\n\n![](https://static.zhangkunzhi.com/typecho/2020/07/24/603402218498341/1595560337.png)\n\n\n\n----\n\n### 美女壁纸下载器\n![美女壁纸下载器](https://zok-blog.oss-cn-hangzhou.aliyuncs.com/images/20190818/WX20191106-114450.png)\n\n\n### 双色球头奖分布词云\n![双色球头奖](https://zok-blog.oss-cn-hangzhou.aliyuncs.com/images/20191107/result.jpg?x-oss-process=image/resize,w_700)\n![双色球](https://zok-blog.oss-cn-hangzhou.aliyuncs.com/images/20191107/WX20191108-152008%402x.png?x-oss-process=image/resize,w_700)\n\n### 工具：解码器\n\n![可拓展式编码转换器](https://zok-blog.oss-cn-hangzhou.aliyuncs.com/images/%E7%89%B9%E6%AE%8A.gif)\n\n### 滑块还原识别\n\n![可拓展式编码转换器](https://zok-blog.oss-cn-hangzhou.aliyuncs.com/images/20190818/bg.png)\n\n\n![可拓展式编码转换器](https://zok-blog.oss-cn-hangzhou.aliyuncs.com/images/20190818/chache.png)\n\n\n### 腾讯滑块缺口识别\n\n![缺口识别](https://zok-blog.oss-cn-hangzhou.aliyuncs.com/images/20190818/WX20191011-203441%402x.png?x-oss-process=image/resize,h_200)\n\n\n## QQ 讨论群\n![](https://zok-blog.oss-cn-hangzhou.aliyuncs.com/2019/11/18/wx201911181627012x.png?x-oss-process=image/resize,h_300)\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwkunzhi%2Fpython3-spider","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fwkunzhi%2Fpython3-spider","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwkunzhi%2Fpython3-spider/lists"}