{"id":18721000,"url":"https://github.com/spajai/weather-analytics-data-miner","last_synced_at":"2026-05-04T14:45:06.693Z","repository":{"id":167470688,"uuid":"526687306","full_name":"spajai/weather-analytics-data-miner","owner":"spajai","description":"Mine Weather data for analytics using Perl, RabbitMQ, MongoDB, Yahoo API (Free tier)","archived":false,"fork":false,"pushed_at":"2022-08-19T17:07:24.000Z","size":25,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2024-12-28T11:41:34.356Z","etag":null,"topics":["data-analytics","data-mining","data-science","message-queue","mongodb","perl","perl5","rabbitmq","weather-api","yahoo-weather-api"],"latest_commit_sha":null,"homepage":"https://github.com/spajai/weather-analytics-data-miner","language":"Perl","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/spajai.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-08-19T16:59:36.000Z","updated_at":"2022-09-15T17:45:48.000Z","dependencies_parsed_at":null,"dependency_job_id":"98aa2ad1-180e-47e2-8e7c-a5b255027e62","html_url":"https://github.com/spajai/weather-analytics-data-miner","commit_stats":null,"previous_names":["spajai/weather-analytics-data-miner"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/spajai%2Fweather-analytics-data-miner","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/spajai%2Fweather-analytics-data-miner/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/spajai%2Fweather-analytics-data-miner/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/spajai%2Fweather-analytics-data-miner/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/spajai","download_url":"https://codeload.github.com/spajai/weather-analytics-data-miner/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":239585195,"owners_count":19663525,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-analytics","data-mining","data-science","message-queue","mongodb","perl","perl5","rabbitmq","weather-api","yahoo-weather-api"],"created_at":"2024-11-07T13:33:14.715Z","updated_at":"2025-11-11T00:30:19.507Z","avatar_url":"https://github.com/spajai.png","language":"Perl","funding_links":[],"categories":[],"sub_categories":[],"readme":"Prerequisite: - \r\n\r\n```\r\nPerl,\r\nRabbitMq\r\nMongoDb,\r\nubuntu linux,\r\nELK stack\r\ncpan \r\nMoose\r\nNet::RabbitFoot\r\n    \r\nNET::AMQ\r\nXML::LibXML\r\n```\r\n`mongo db and rabbitmq conf ip 0.0.0.0`\r\n\r\n```\r\nsudo apt install x86_64-linux-gnu-gcc\r\nsudo apt install libxml2-dev icu-devtools libicu-dev libstdc++-5-dev libxml2-dev\r\nxml2\r\nlibxml2\r\nsudo apt install mtools    \r\n```\r\n`rabbitmq-plugins enable rabbitmq_management`\r\n\r\n\r\n* logger\r\n\r\n`PERL_DL_NONLAZY=1 \"/usr/bin/perl\" \"-MExtUtils::Command::MM\" \"-MTest::Harness\" \"-e\" \"undef *Test::Harness::Switches; test_harness(0, 'blib/lib', 'blib/arch')\" t/*.t`\r\n\r\n\r\n```\r\ncpan shell\r\nreload\r\nupgrade\r\n\r\nAdd a new/fresh user, say user ‘test’ and password ‘test’\r\n\r\nrabbitmqctl add_user test test\r\nGive administrative access to the new access\r\n\r\nrabbitmqctl set_user_tags test administrator\r\nSet permission to newly created user\r\n\r\nrabbitmqctl set_permissions -p / test \".*\" \".*\" \".*\"\r\n```\r\n\r\n```\r\nClient ID (Consumer Key) FROM RMQ\r\nXXXXXXXXXX--\r\nClient Secret (Consumer Secret)\r\nYYYYYYYYYYYYYYY\r\n```\r\n\r\n\r\n* Add these config to Conf.pm modify and start\r\n* pull data using Perl script\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fspajai%2Fweather-analytics-data-miner","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fspajai%2Fweather-analytics-data-miner","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fspajai%2Fweather-analytics-data-miner/lists"}