{"id":14978773,"url":"https://github.com/lb2281075105/python-spider","last_synced_at":"2025-04-12T22:34:30.796Z","repository":{"id":62744165,"uuid":"110858120","full_name":"lb2281075105/Python-Spider","owner":"lb2281075105","description":"豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章","archived":false,"fork":false,"pushed_at":"2022-08-27T14:06:42.000Z","size":1757,"stargazers_count":786,"open_issues_count":0,"forks_count":277,"subscribers_count":53,"default_branch":"master","last_synced_at":"2025-04-04T01:47:31.608Z","etag":null,"topics":["beautifulsoup4","crawlspider","django","itchat","mongodb","mysql","pymysql","python","redis","scrapy","selenium","spider","weichat","xpath"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":false,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/lb2281075105.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2017-11-15T16:26:59.000Z","updated_at":"2025-04-02T16:53:56.000Z","dependencies_parsed_at":"2022-11-05T15:45:55.222Z","dependency_job_id":null,"html_url":"https://github.com/lb2281075105/Python-Spider","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lb2281075105%2FPython-Spider","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lb2281075105%2FPython-Spider/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lb2281075105%2FPython-Spider/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lb2281075105%2FPython-Spider/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/lb2281075105","download_url":"https://codeload.github.com/lb2281075105/Python-Spider/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248642308,"owners_count":21138350,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup4","crawlspider","django","itchat","mongodb","mysql","pymysql","python","redis","scrapy","selenium","spider","weichat","xpath"],"created_at":"2024-09-24T13:58:21.810Z","updated_at":"2025-04-12T22:34:30.775Z","avatar_url":"https://github.com/lb2281075105.png","language":"Python","readme":"# Python-Spider\n1、豆瓣电影top250\u003cbr\u003e\n2、斗鱼爬取json数据以及爬取美女图片\u003cbr\u003e\n3、CrawlSpider爬取红娘网相亲人的部分基本信息、红娘网分布式爬取、存储redis\u003cbr\u003e\n4、爬虫小demo\u003cbr\u003e\n5、Selenium的使用\u003cbr\u003e\n6、PIL\u003cbr\u003e\n7、爬多点商品存储mysql数据库同时显示在djangoweb页面\u003cbr\u003e\n8、django开发接口\u003cbr\u003e\n9、python txt、csv、xml文件解析\u003cbr\u003e\n10、Scrapy框架进行Spiders简单爬虫\u003cbr\u003e\n11、抓取淘宝美女信息，下载本地并存储mysql数据库\u003cbr\u003e\n12、爬取有缘网用户信息\u003cbr\u003e\n13、模拟Github登陆\u003cbr\u003e\n14、selenium动态模拟登录\u003cbr\u003e\n15、模拟知乎登录\u003cbr\u003e\n16、爬取tencent社招信息\u003cbr\u003e\n17、[爬取《多点》整站商品信息](https://github.com/lb2281075105/LBDuoDian)\u003cbr\u003e\n18、模拟京东登录\u003cbr\u003e\n19、下载网易云歌词\u003cbr\u003e\n20、淘宝信息\u003cbr\u003e\n21、京东商城商品详情页信息\u003cbr\u003e\n22、模拟图虫网登录\u003cbr\u003e\n23、itchat 获取微信群或者微信好友分享文章\u003cbr\u003e\n24、爬取微信公众号历史文章\u003cbr\u003e\n25、itchat监听指定微信公众号分享的文章\u003cbr\u003e\n26、itchat微信群微信好友防撤回\u003cbr\u003e\n27、在微信群之间转发消息\u003cbr\u003e\n27、下载bilibili视频  也可以下载哔哩哔哩集合视频\u003cbr\u003e\n28、爬取m3u8视频\u003cbr\u003e\n\n详细请移步简书[Python文集](http://www.jianshu.com/nb/18442681)\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flb2281075105%2Fpython-spider","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Flb2281075105%2Fpython-spider","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flb2281075105%2Fpython-spider/lists"}