{"id":20693013,"url":"https://github.com/deepcs233/project_hot2","last_synced_at":"2026-04-24T09:36:48.235Z","repository":{"id":111794198,"uuid":"78631938","full_name":"deepcs233/Project_hot2","owner":"deepcs233","description":null,"archived":false,"fork":false,"pushed_at":"2017-07-05T12:42:52.000Z","size":101717,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"master","last_synced_at":"2025-03-11T01:46:38.221Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/deepcs233.png","metadata":{"files":{"readme":"README.md","changelog":"news2words.csv","contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-01-11T11:19:29.000Z","updated_at":"2017-12-22T06:35:22.000Z","dependencies_parsed_at":null,"dependency_job_id":"f8409617-72c6-47ca-90ae-3b0306dba6a0","html_url":"https://github.com/deepcs233/Project_hot2","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/deepcs233/Project_hot2","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepcs233%2FProject_hot2","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepcs233%2FProject_hot2/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepcs233%2FProject_hot2/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepcs233%2FProject_hot2/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/deepcs233","download_url":"https://codeload.github.com/deepcs233/Project_hot2/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepcs233%2FProject_hot2/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32217051,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-24T08:24:32.376Z","status":"ssl_error","status_checked_at":"2026-04-24T08:24:26.731Z","response_time":64,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-16T23:24:54.424Z","updated_at":"2026-04-24T09:36:43.228Z","avatar_url":"https://github.com/deepcs233.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Project-hot2\n热气球\n\n## naive-scrapy-master\n\n### 使用方法：在文件夹下运行scrapy crawl all\n\n\n\n## DataProcess 文件夹的文件完成对数据的预处理 \n\n* clac_news_hot.py 计算新闻热度\n* clac_word_freq.py  计算词语热度\n* classify_news.py  分类新闻\n* clean_str.py  字符串清理包，被其他程序引用\n* hot_muti_count.py  将新闻的热度与count计算，count越高热度越高，count为0的新闻热度也为0，将不再被显示\n* rm_samenews.py  将重复的新闻count置0，将其count转移至其中的一条新闻上\n* basic 基类，被其他类所继承\n\n## PrepareJson 提供基本的json文件\n\n* gen_basic_json.py 提供基本的json\n* relatedGraph.py  关系图的数据json\n* read_graph/topics/words.py  用于美观展示生成的json文件\n\n\n\n### contrast_web.py 对比网页，返回改动内容\n\n### processdata.py 集成DataProcess 的文件，运行后可以一次生成所有基本数据\n\n### settings.py 存放配置及常数\n\n### utils.py 存放常用函数\n\n### stopwords.dat 停用词表\n\n\n\n\n\n\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdeepcs233%2Fproject_hot2","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdeepcs233%2Fproject_hot2","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdeepcs233%2Fproject_hot2/lists"}