Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/zealot128/filter-app
Rails app - news aggregator that powers http://hrfilter.de and http://fahrrad-filter.de
https://github.com/zealot128/filter-app
news-aggregator rails rss
Last synced: about 1 month ago
JSON representation
Rails app - news aggregator that powers http://hrfilter.de and http://fahrrad-filter.de
- Host: GitHub
- URL: https://github.com/zealot128/filter-app
- Owner: zealot128
- License: mit
- Created: 2015-09-22T14:00:05.000Z (about 9 years ago)
- Default Branch: master
- Last Pushed: 2024-06-03T08:53:47.000Z (7 months ago)
- Last Synced: 2024-08-05T08:08:09.123Z (5 months ago)
- Topics: news-aggregator, rails, rss
- Language: Ruby
- Size: 27.3 MB
- Stars: 27
- Watchers: 10
- Forks: 16
- Open Issues: 30
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- Open-Source-Ruby-and-Rails-Apps - filter-app - news aggregator that powers http://hrfilter.de and http://fahrrad-filter.de 🔥 ✅ 🚀 (Happy Exploring 🤘)
README
[](https://travis-ci.org/zealot128/filter-app)
# News aggregator app
This is a Ruby-on-Rails app for running (German) news aggregator websites. Today, it powers:
* http://www.hrfilter.de (German news of HR/personal/recruiting)
* http://www.fahrrad-filter.de (German/English news of cycling topic)
## Reasoning
I want to follow news of those two areas but struggle with RSS, as it is too much for me too process - I want to see the most "relevant" sources at once, without investing too much time. Other sources, like Twitter + Reddit I found too noisy to follow.
This is why I created that app
## News fetching + scoring algorithm
The admin of the apps curates a list of trusted sources. Those will regularly checked for new content. Following news sources are supported:
* RSS/Atom feeds (FeedSource)
* Podcast via RSS/Atom (similar as FeedSource but different visual)
* Twitter Streams
* (in planning) RedditSources - subscribe whole /r/'s
In similar fashion, the app checks popularity of the news in social network, that means:
* Facebook likecount (as reported by Facebook Like Button)
* Twitter retweets + favorites (as reported by Twitter API)
* XING + LinkedIn shares (as reported by regarding Widgets)
* Reddit total score sum in all subreddits (if exists)
* Each of those sources is configured with a different value (e.g. Facebook likes are more common, so less value than XING share)
The admin of the sites can give a Source individual:
* Base factor (that means, how much "Likes" any link of that website is worth, can also be negative too remove noise from some sources)
* Multiplicator, e.g. 0.2, 1.0, 2.0 - each like will be multiplied by that number -- Some sources have a much higher reach and can be leveled out so the news are more broad
Altogether, the score is calculated regularly for fresh links.
For Display on the homepage, the freshness is also important - the older the link, the more the score is reduced.
## Topics
The topic matching is very simple - just simple keyword lists. That means, the categorization is far far from perfect or even good. It might be an area of further development :)
## Newsletter
It is possible to subscribe via E-Mail. Then, once per week on sunday, you will receive a Mail with from the selected topics.
# Development
As it is a Rails app, you can try to run it yourself. First make sure to have installed:
- Linux or macos
- Ruby 3.3+
- Postgresql 11++
- nodejs 16.0+ and yarn
```
git clone https://github.com/zealot128/filter-app.git
cd filter-app
bin/setup
```
To run the app + background worker + webpack run:
```
foreman start
```
If anything fails, then you might need to adjust the ``config/database.yml`` to configure the correct database or run the individual commands
Otherwise: you can check out the running app on ``localhost:5000``