{"id":15037420,"url":"https://github.com/python3spiders/weibosuperspider","last_synced_at":"2025-04-08T09:11:28.297Z","repository":{"id":40643781,"uuid":"214641640","full_name":"Python3Spiders/WeiboSuperSpider","owner":"Python3Spiders","description":"微博爬虫及配套工具箱，微博用户、话题、评论采集一网打尽。图片下载、情感分析，地理位置、关系网络、spammer 机器人识别等功能应有尽有。Docs：https://buyixiao.github.io/blog/weibo-super-spider.html 配套可视化网站：https://buyixiao.github.io/blog/one-stop-weibo-visualization.html","archived":false,"fork":false,"pushed_at":"2023-04-23T16:19:50.000Z","size":334,"stargazers_count":1650,"open_issues_count":0,"forks_count":334,"subscribers_count":22,"default_branch":"master","last_synced_at":"2025-04-08T09:11:22.552Z","etag":null,"topics":["emotion-analysis","location-tracker","weibo-comment-crawl","weibo-image","weibo-spider","weibocrawler","weibospider"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Python3Spiders.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null},"funding":{"github":null,"patreon":null,"open_collective":null,"ko_fi":null,"tidelift":null,"community_bridge":null,"liberapay":null,"issuehunt":null,"otechie":null,"custom":["https://afdian.net/@buyixiao","https://inspurer.github.io/thank/"]}},"created_at":"2019-10-12T12:14:02.000Z","updated_at":"2025-04-05T13:53:27.000Z","dependencies_parsed_at":"2024-01-13T16:22:16.922Z","dependency_job_id":"facf5330-1f8a-4c25-9942-cfcf7874c2e7","html_url":"https://github.com/Python3Spiders/WeiboSuperSpider","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Python3Spiders%2FWeiboSuperSpider","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Python3Spiders%2FWeiboSuperSpider/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Python3Spiders%2FWeiboSuperSpider/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Python3Spiders%2FWeiboSuperSpider/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Python3Spiders","download_url":"https://codeload.github.com/Python3Spiders/WeiboSuperSpider/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247809964,"owners_count":20999816,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["emotion-analysis","location-tracker","weibo-comment-crawl","weibo-image","weibo-spider","weibocrawler","weibospider"],"created_at":"2024-09-24T20:34:36.178Z","updated_at":"2025-04-08T09:11:28.269Z","avatar_url":"https://github.com/Python3Spiders.png","language":"Python","funding_links":["https://afdian.net/@buyixiao","https://inspurer.github.io/thank/"],"categories":[],"sub_categories":[],"readme":"### 项目简介\n\n微博爬虫及配套工具箱，一站式微博爬虫采集、分析、可视化工具。微博用户、话题、评论爬虫一网打尽；图片下载、情感分析，地理位置、关系网络、机器人识别等功能应有尽有。\n\n项目遵循以下两个设计原则：\n\n\u003cul\u003e\n\u003cli\u003e爬虫抓取的数据保存在 Excel 可以打开的 CSV 中，不依赖任何数据库。\u003c/li\u003e\n\n\u003cli\u003e每个功能 Feat 对应的爬虫文件都是相互独立的，不存在依赖关系，虽然不利于维护和重构，但是对于使用者友好。\u003c/li\u003e\n\u003c/ul\u003e\n\n### 作者简介\n\n|作者|[inspurer](https://inspurer.github.io/2018/06/07/%E6%9C%88%E5%B0%8F%E6%B0%B4%E9%95%BF%E7%9A%84%E7%94%B1%E6%9D%A5/#more)|\n|:---:|:---:|\n|QQ交流群|[751114777](https://jq.qq.com/?_wv=1027\u0026k=BJI3pLAq)|\n|个人博客|[https://buyixiao.github.io/](https://inspurer.github.io/)|\n\n### 项目资料\n\n|Docs|[2022 最新指南 ](https://buyixiao.github.io/blog/weibo-super-spider.html)|\n|:---:|:---:|\n|配套的自助抓取网站（顺带任意深度和广度的微博用户关系（关注/粉丝）网络构建、任意深度和广度的微博转发路径网络、微博、评论、签到等数据集在线构建）、微博 Spammer 识别|[execute data crawling without any environment setting](https://weibo-crawl-visual.buyixiao.xyz/)|\n|配套的微博可视化网站|[https://buyixiao.github.io/blog/one-stop-weibo-visualization.html](https://buyixiao.github.io/blog/one-stop-weibo-visualization.html)|\n| 包含世界、中国-省-市地图和动态排序柱状图、桑基图、关系图、弦图、旭日图、树图、矩形树图等图表在线配置数据可视化工具网站|[https://tools.buyixiao.xyz/](https://tools.buyixiao.xyz/)|\n|微博签到相关可视化 B 站教程|[https://www.bilibili.com/video/BV1S14y1x73y](https://www.bilibili.com/video/BV1S14y1x73y)|\n\n### 项目声明\n\nIf you use this project in your research, please cite this project.\n\n```\n@misc{WeiboSuperSpider,\n    author = {Tao Xiao},\n    title = {微博超级爬虫，最强微博爬虫，用户、话题、评论一网打尽。图片下载、情感分析，地理位置、关系网络等功能应有尽有。},\n    year = {2019},\n    publisher = {GitHub},\n    journal = {GitHub repository},\n    howpublished = {\\url{https://github.com/Python3Spiders/WeiboSuperSpider}},\n}\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpython3spiders%2Fweibosuperspider","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpython3spiders%2Fweibosuperspider","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpython3spiders%2Fweibosuperspider/lists"}