{"id":21690529,"url":"https://github.com/oli51467/storm_semesterproject","last_synced_at":"2026-05-20T10:39:56.065Z","repository":{"id":154681557,"uuid":"525020166","full_name":"Oli51467/Storm_SemesterProject","owner":"Oli51467","description":"qdu大三下-大数据学期项目","archived":false,"fork":false,"pushed_at":"2023-08-09T13:29:02.000Z","size":9268,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-25T13:07:56.347Z","etag":null,"topics":["kafka","storm"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Oli51467.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-08-15T14:32:41.000Z","updated_at":"2023-08-10T08:44:37.000Z","dependencies_parsed_at":null,"dependency_job_id":"28aa8fed-34d0-4a32-a990-93ef538e5874","html_url":"https://github.com/Oli51467/Storm_SemesterProject","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Oli51467%2FStorm_SemesterProject","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Oli51467%2FStorm_SemesterProject/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Oli51467%2FStorm_SemesterProject/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Oli51467%2FStorm_SemesterProject/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Oli51467","download_url":"https://codeload.github.com/Oli51467/Storm_SemesterProject/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":244618434,"owners_count":20482316,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["kafka","storm"],"created_at":"2024-11-25T17:31:41.490Z","updated_at":"2026-05-20T10:39:51.043Z","avatar_url":"https://github.com/Oli51467.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Storm_Project\n\n#### 介绍\n大三下大数据学期项目\n\n#### 项目整体要求\n\n- 项目的主旨是使用STORM的实时计算，对给出的数据进行分析。\n- 实现“语音实时地图展示”。\n- 将分析所得数据结果进行数据可视化。\n#### 使用说明\n\n1.  在宝塔Mysql新建表Location、InvalidCity\n2.  Kafka新建Topic:test1\n3.  安装Hadoop、Storm、Kafka\n4.  启动服务 发布Topology\n5.  启动生产者实例将数据放入消息队列\n\n#### 功能需求\n\n1.  “语音实时地图展示”项目的需求是将用户登录的地点实时显示在地图上，数据量为每天一亿，每秒峰值20000（此次项目是对这一秒的样本数据进行处理），要求系统具备高可靠性。\n2.  数据字典：\n    - 手机APP访问日志数据见文件app.log，数据中共有11个字段，字段之间的分隔符为\\t。\n\n    ![实例结果](./app-data.png)\n    - 地区和IP地址的对应关系数据见文件ip_area_isp.txt，数据中共有6个字段，字段之间的分隔符为\\t。\n    ![实例结果](./ip-data.png)\n    - 地区和经纬度的对应关系数据见文件lng-lat-mapping.txt，数据中共有3个字段，字段之间的分隔符为\\t。\n    ![实例结果](./lng-lat-data.png)\n3.  Storm的拓扑图：根据业务要求，设计合理的Storm的Topology的拓扑图\n4.  接收数据源：接收手机APP产生的实时日志信息。\n5. 对数据源进行实时处理：将APP的日志信息中的网络IP字段提取出来将其转换为地址，再将地址转换为具体的经纬度，数据落地在MySQL数据库中，然后通过调用ECharts或者积木报表地图API获得地图页面，根据获得的数据在地图上展示相应的地理位置。\n6. 通过图形化展示，对数据进行结果的分析总结\n\n实例结果：\n   ![实例结果](./res-example.png)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Foli51467%2Fstorm_semesterproject","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Foli51467%2Fstorm_semesterproject","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Foli51467%2Fstorm_semesterproject/lists"}