{"id":18004017,"url":"https://github.com/simon987/reddit_feed","last_synced_at":"2026-04-28T11:03:19.325Z","repository":{"id":80438250,"uuid":"201481142","full_name":"simon987/reddit_feed","owner":"simon987","description":"Fault-tolerant daemon that fetches comments \u0026  submissions from reddit","archived":false,"fork":false,"pushed_at":"2020-04-10T12:10:51.000Z","size":103,"stargazers_count":4,"open_issues_count":0,"forks_count":0,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-04-04T09:45:02.745Z","etag":null,"topics":["reddit","redis"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/simon987.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-08-09T14:17:19.000Z","updated_at":"2024-01-29T03:44:28.000Z","dependencies_parsed_at":null,"dependency_job_id":"6ae798fe-41cb-41fc-b98d-5bb40d38e1ba","html_url":"https://github.com/simon987/reddit_feed","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/simon987/reddit_feed","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/simon987%2Freddit_feed","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/simon987%2Freddit_feed/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/simon987%2Freddit_feed/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/simon987%2Freddit_feed/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/simon987","download_url":"https://codeload.github.com/simon987/reddit_feed/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/simon987%2Freddit_feed/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32377599,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-28T09:24:15.638Z","status":"ssl_error","status_checked_at":"2026-04-28T09:24:15.071Z","response_time":56,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["reddit","redis"],"created_at":"2024-10-30T00:13:11.234Z","updated_at":"2026-04-28T11:03:19.302Z","avatar_url":"https://github.com/simon987.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# reddit_feed\n\nFault-tolerant daemon that fetches comments \u0026 \nsubmissions from reddit and publishes serialised\n JSON to RabbitMQ for real-time ingest.\n\nCan read up to 100 items per second (~6k/min), as per the API limits for\na single client.\n\nCan optionally push monitoring data to InfluxDB. Below is an\nexample of Grafana being used to display it.\n\nThe daemon will attempt to stay exactly `REALTIME_DELAY` (60 by default)\nseconds 'behind' realtime items. Of course, it can lag several minutes\nbehind when the number of events exceeds 100/s. In this case, \nit will eventually catch up to the target time during lower traffic\nhours.\n\n![monitoring](monitoring.png)\n\nTested on GNU/Linux amd64, it uses ~60Mb of memory.\n\n### Usage\n```\npython run.py \u003cRabbitMQ host\u003e\n```\n\n(It is recommended to run with `supervisord`, \nsee [supervisord_reddit_feed.ini](supervisord_reddit_feed.ini))","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsimon987%2Freddit_feed","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsimon987%2Freddit_feed","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsimon987%2Freddit_feed/lists"}