{"id":19336654,"url":"https://github.com/kimmeen/weibo-analyst","last_synced_at":"2025-04-04T18:09:05.464Z","repository":{"id":47023281,"uuid":"118928348","full_name":"KimMeen/Weibo-Analyst","owner":"KimMeen","description":"Social media (Weibo) comments analyzing toolbox in Chinese 微博评论分析工具, 实现功能: 1.微博评论数据爬取; 2.分词与关键词提取; 3.词云与词频统计; 4.情感分析; 5.主题聚类","archived":false,"fork":false,"pushed_at":"2019-08-08T12:03:58.000Z","size":47152,"stargazers_count":797,"open_issues_count":2,"forks_count":184,"subscribers_count":19,"default_branch":"master","last_synced_at":"2025-03-28T17:11:19.720Z","etag":null,"topics":["crawler","lda","sentiment-analysis","weibo","word-clouds"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/KimMeen.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2018-01-25T15:09:27.000Z","updated_at":"2025-03-28T06:20:19.000Z","dependencies_parsed_at":"2022-08-12T13:11:26.900Z","dependency_job_id":null,"html_url":"https://github.com/KimMeen/Weibo-Analyst","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KimMeen%2FWeibo-Analyst","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KimMeen%2FWeibo-Analyst/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KimMeen%2FWeibo-Analyst/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KimMeen%2FWeibo-Analyst/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/KimMeen","download_url":"https://codeload.github.com/KimMeen/Weibo-Analyst/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247226215,"owners_count":20904465,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawler","lda","sentiment-analysis","weibo","word-clouds"],"created_at":"2024-11-10T03:11:54.786Z","updated_at":"2025-04-04T18:09:05.441Z","avatar_url":"https://github.com/KimMeen.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"## About This Repository\n\n**Please follow the restrictions in Apache-2.0 Licence before you refer to this repository.** \n\n**@Ming Jin** (*mingj2@student.unimelb.edu.au*)\n\nThis repository is a simple NLP project for beginners and will be updated occasionally.\n\nEnvironment: Python3.6\n\n**Pull requests are always welcome!**\n\nTo-do list:\n1. Sentiment analysis can be done by using LSTM.\n2. Crawler can be improved based on some libraries like BeautifulSoup.\n\n## Introduction\n\n这是一个微博评论分析工具，实现功能主要有：\n1. 微博评论数据爬取\n2. 分词与关键词提取\n3. 词云与词频统计\n4. 情感分析\n5. 主题聚类\n\n正常状态下实现效果在: “ 案例：泰国大象踩踏伤人事件 ”\n注意：案例中最后表格需要自己根据LDA结果进行统计\n\nThis is a Weibo comments processing toolbox, which has been implemented for:\n\n1. Weibo comments crawler that based on regular expression\n2. Tokenization, filtration and key words extraction\n3. Words cloud and visualization\n4. Sentiment analysis\n5. Topic clustering that based on LDA\n\n\n## Pre-Requirements Checklist\n\n*MySQL is required (e.g., You may use MySQL Workbench)*\n\n1. importlib\n2. sys\n3. time\n4. requests\n5. lxml\n6. pymysql\n7. jieba\n8. PIL\n10. wordcloud\n11. snownlp\n12. logging\n13. configparser\n14. random\n15. codecs\n\n\n## Citing The Code\n\nBibTex reference format:\n```\n@misc{WeiboAnalyst,\ntitle={Weibo-Analyst: An Open-Source Python Library for Social Media Comments Analysis},\nurl={https://github.com/KimMeen/Weibo-Analyst},\nauthor={Ming Jin},\nyear={2018}\n}\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkimmeen%2Fweibo-analyst","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkimmeen%2Fweibo-analyst","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkimmeen%2Fweibo-analyst/lists"}