https://github.com/spajai/weather-analytics-data-miner

Mine Weather data for analytics using Perl, RabbitMQ, MongoDB, Yahoo API (Free tier)
https://github.com/spajai/weather-analytics-data-miner

data-analytics data-mining data-science message-queue mongodb perl perl5 rabbitmq weather-api yahoo-weather-api

Last synced: 8 days ago
JSON representation

Mine Weather data for analytics using Perl, RabbitMQ, MongoDB, Yahoo API (Free tier)

• Host: GitHub
• URL: https://github.com/spajai/weather-analytics-data-miner
• Owner: spajai
• License: gpl-3.0
• Created: 2022-08-19T16:59:36.000Z (over 2 years ago)
• Default Branch: master
• Last Pushed: 2022-08-19T17:07:24.000Z (over 2 years ago)
• Last Synced: 2024-11-07T13:42:08.399Z (about 2 months ago)
• Topics: data-analytics, data-mining, data-science, message-queue, mongodb, perl, perl5, rabbitmq, weather-api, yahoo-weather-api
• Language: Perl
• Homepage: https://github.com/spajai/weather-analytics-data-miner
• Size: 24.4 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
Prerequisite: - 

```

Perl,

RabbitMq

MongoDb,

ubuntu linux,

ELK stack

cpan 

Moose

Net::RabbitFoot

    

NET::AMQ

XML::LibXML

```

`mongo db and rabbitmq conf ip 0.0.0.0`

```

sudo apt install x86_64-linux-gnu-gcc

sudo apt install libxml2-dev icu-devtools libicu-dev libstdc++-5-dev libxml2-dev

xml2

libxml2

sudo apt install mtools    

```

`rabbitmq-plugins enable rabbitmq_management`

* logger

`PERL_DL_NONLAZY=1 "/usr/bin/perl" "-MExtUtils::Command::MM" "-MTest::Harness" "-e" "undef *Test::Harness::Switches; test_harness(0, 'blib/lib', 'blib/arch')" t/*.t`

```

cpan shell

reload

upgrade

Add a new/fresh user, say user ‘test’ and password ‘test’

rabbitmqctl add_user test test

Give administrative access to the new access

rabbitmqctl set_user_tags test administrator

Set permission to newly created user

rabbitmqctl set_permissions -p / test ".*" ".*" ".*"

```

```

Client ID (Consumer Key) FROM RMQ

XXXXXXXXXX--

Client Secret (Consumer Secret)

YYYYYYYYYYYYYYY

```

* Add these config to Conf.pm modify and start

* pull data using Perl script