https://github.com/payload/propaganda
https://github.com/payload/propaganda
Last synced: 2 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/payload/propaganda
- Owner: payload
- Created: 2020-09-05T13:00:19.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2020-09-29T22:38:06.000Z (over 4 years ago)
- Last Synced: 2025-02-10T09:11:46.350Z (4 months ago)
- Language: Rust
- Size: 40 KB
- Stars: 1
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# propaganda
Articles on the internet are published but changed afterwards.
This can be surprising.
Let's show where this happens.
## tech outline
* either with tokio
* use warp for HTTP server
* use reqwest for HTTP client
* or with async-std
* use tide for HTTP server
* use surf for HTTP client
* use scraper to deal with HTML
* use sled for an prototype DB file
* use difftastic or prettydiff for diff generation
* safe snapshots of articles in the DB, generate diff on demand
## todos
* [x] fetch tageschau.de article with scraper
* [ ] store article in sled