https://github.com/margostino/climateline-processor

News collector and publisher for Climateline
https://github.com/margostino/climateline-processor

climate-change climateline golang news

Last synced: 2 days ago
JSON representation

News collector and publisher for Climateline

• Host: GitHub
• URL: https://github.com/margostino/climateline-processor
• Owner: margostino
• License: apache-2.0
• Created: 2022-08-30T06:42:02.000Z (over 2 years ago)
• Default Branch: master
• Last Pushed: 2023-03-27T17:37:13.000Z (almost 2 years ago)
• Last Synced: 2024-11-10T09:13:46.849Z (about 2 months ago)
• Topics: climate-change, climateline, golang, news
• Language: Go
• Homepage: https://climateline.vercel.app
• Size: 1.03 MB
• Stars: 2
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Security: security/authorization.go

Awesome Lists containing this project

README

        
# climateline-processor

[![Build & Test](https://github.com/margostino/climateline-processor/actions/workflows/main.yml/badge.svg?branch=master)](https://github.com/margostino/climateline-processor/actions/workflows/main.yml)

[![collector-job](https://github.com/margostino/climateline-processor/actions/workflows/collector-job.yml/badge.svg?branch=master)](https://github.com/margostino/climateline-processor/actions/workflows/collector-job.yml)

[![publisher-dispatcher](https://github.com/margostino/climateline-processor/actions/workflows/publisher-dispatcher.yml/badge.svg?branch=master)](https://github.com/margostino/climateline-processor/actions/workflows/publisher-dispatcher.yml)

This repo implements the job to fetch the daily news of Climate Change.  

The job retrieve every news into the Admin Telegram Bot in order to approve, edit and push new article into [Climateline](https://climateline.vercel.app/) website.

The main motivation behind is to automate and easy the news uploading with zero line of code from everywhere and whenever you want using a Telegram Bot connection. 

### Architecture

![](assets/architecture.png#100x)

### Features

- [x] Cron job for fetching news

- [x] Telegram bot for handling news workflow (upload, update) towards [Climateline](https://climateline.vercel.app/)

- [x] Basic and short-time caching

- [x] Multi-Source News Fetcher

- [ ] Create entirely new articles

- [ ] Detect duplicated article before pushing

- [ ] Pushing by replying

- [ ] Detect automatically properties such as location, source, category

- [ ] Deploy only if build and tests pass

- [ ] Isolate news fetcher API