{"id":16894068,"url":"https://github.com/firefart/rss_fetcher","last_synced_at":"2025-07-30T23:34:48.219Z","repository":{"id":34408117,"uuid":"130854412","full_name":"firefart/rss_fetcher","owner":"firefart","description":"golang program to send RSS feeds per E-Mail","archived":false,"fork":false,"pushed_at":"2025-07-11T12:07:52.000Z","size":284,"stargazers_count":11,"open_issues_count":0,"forks_count":2,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-07-11T15:02:10.967Z","etag":null,"topics":["feed","go","golang","rss","rss-aggregator","rss-feed-scraper","rss-fetcher"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/firefart.png","metadata":{"files":{"readme":"Readme.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null},"funding":{"github":"firefart","patreon":"firefart"}},"created_at":"2018-04-24T12:56:27.000Z","updated_at":"2025-07-11T12:07:55.000Z","dependencies_parsed_at":"2023-02-15T22:45:47.455Z","dependency_job_id":"196a187c-e41c-4c00-ab70-fe51d1ce8fe4","html_url":"https://github.com/firefart/rss_fetcher","commit_stats":{"total_commits":225,"total_committers":5,"mean_commits":45.0,"dds":0.5333333333333333,"last_synced_commit":"edbf0a86716d286417227e88cf95ac9dbc32c810"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/firefart/rss_fetcher","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/firefart%2Frss_fetcher","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/firefart%2Frss_fetcher/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/firefart%2Frss_fetcher/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/firefart%2Frss_fetcher/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/firefart","download_url":"https://codeload.github.com/firefart/rss_fetcher/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/firefart%2Frss_fetcher/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":267960841,"owners_count":24172508,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-30T02:00:09.044Z","response_time":70,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["feed","go","golang","rss","rss-aggregator","rss-feed-scraper","rss-fetcher"],"created_at":"2024-10-13T17:17:34.844Z","updated_at":"2025-07-30T23:34:48.197Z","avatar_url":"https://github.com/firefart.png","language":"Go","funding_links":["https://github.com/sponsors/firefart","https://patreon.com/firefart"],"categories":[],"sub_categories":[],"readme":"# RSS Fetcher\n\nThis little GO program is intended to fetch all configured RSS or ATOM feeds every hour (configurable) and send new entries per E-Mail.\n\nThis project is mainly written because IFTT can not handle crt.sh feeds :/\n\nExpected errors during execution are also sent via E-Mail to the E-Mail address configured in `config.json`.\n\nFor sending mails you should setup a local SMTP server like postfix to handle resubmission, signing and so on for you. SMTP authentication is currently not implemented.\n\nThe program keeps the last date of the last entry per feed in it's database to compare it to on the next fetch.\nWe can't just use the current date because crt.sh is caching it's feeds and they do not appear at the time written in the feed.\n\n## Installation on a systemd based system\n\n- Build binary or download it\n\n```bash\nmake\n```\n\nor\n\n```bash\ngo get\ngo build\n```\n\nor\n\n```bash\nmake_linux.bat\nmake_windows.bat\n```\n\n- Add a user to run the binary\n\n```bash\nadduser --system rss\n```\n\n- Copy everything to home dir\n\n```bash\ncp -R checkout_dir /home/rss/\n```\n\n- Modify run time (if you want to run it at other intervalls)\n\n```bash\nvim /home/rss/rss_fetcher.timer\n```\n\n- Edit the config\n\n```bash\ncp /home/rss/config.json.sample /home/rss/config.json\nvim /home/rss/config.json\n```\n\n- Install the service and timer files\n\n```bash\n./install_service.sh\n```\n\n- Watch the logs\n\n```bash\njournalctl -u rss_fetcher.service -f\n```\n\n## Config Sample\n\n```json\n{\n  \"timeout\": 10,\n  \"mailserver\": \"localhost\",\n  \"mailport\": 25,\n  \"mailfrom\": \"RSS \u003ca@a.com\u003e\",\n  \"mailto\": \"People \u003cb@b.com\u003e\",\n  \"mailonerror\": true,\n  \"mailtoerror\": \"c@c.com\",\n  \"database\": \"rss.db\",\n  \"globalignorewords\": [\"ignore1\", \"ignore2\"],\n  \"feeds\": [\n    {\n      \"title\": \"Certificates *.aaa.com\",\n      \"url\": \"https://crt.sh/atom?q=%25.aaa.com\",\n      \"ignorewords\": [\"[Precertificate]\", \"ignore2\"]\n    },\n    {\n      \"title\": \"Certificates *.bbb.com\",\n      \"url\": \"https://crt.sh/atom?q=%25.bbb.com\"\n    }\n  ]\n}\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffirefart%2Frss_fetcher","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffirefart%2Frss_fetcher","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffirefart%2Frss_fetcher/lists"}