https://github.com/asafmaoz1234/seavisiondatafetcher

The Data collector module for SeaVisionPro.com. Spring boot, reactive api requests, dockerized with postgresql.
https://github.com/asafmaoz1234/seavisiondatafetcher

Last synced: about 10 hours ago
JSON representation

The Data collector module for SeaVisionPro.com. Spring boot, reactive api requests, dockerized with postgresql.

• Host: GitHub
• URL: https://github.com/asafmaoz1234/seavisiondatafetcher
• Owner: asafmaoz1234
• Created: 2023-09-15T12:22:21.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2023-11-15T13:25:02.000Z (12 months ago)
• Last Synced: 2023-11-16T13:37:13.339Z (12 months ago)
• Language: Java
• Homepage: https://seavisionpro.com
• Size: 231 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# SeaVision Pro Data Collector



The Data collector module within SeaVision Pro is a sophisticated component designed 


to provide `SeaVision Pro` with the latest weather information for selected coastal locations.
 

Its primary goal is to ensure that we have access to the most accurate and current weather data,
 

allowing us to assess sea visibility conditions effectively.







The module runs as an AWS lambda, triggered by CloudWatch event.

Data is stored on our secured DB's.

github actions - for CI-CD and running tests on pull requests.

Using Spring boot, Java 17, maven build

Dockerized for local dev




  
The process system design:

  


            

        



To do:


 


- Add spring to project

properties:

    - use application.yml for properties in test and prod

    - modify env params to use inject

webclient:

    - use reactive client to fetch data

    - modify client to support different geo locations

    - mock weather api

    - add timeouts

    - change client non blocking

    

database:

    - store results in db

    - set up database connection

    - get locations from db

    - change to reactive database connection

handler:

    - add handler 

    - test to lambda

    - log errors

    - add metrics