{"id":18023156,"url":"https://github.com/rustyconover/reddit-recorder","last_synced_at":"2025-03-26T23:31:00.678Z","repository":{"id":146625429,"uuid":"333495507","full_name":"rustyconover/reddit-recorder","owner":"rustyconover","description":"Save and record comments and submissions from Reddit into S3 for later analysis.","archived":true,"fork":false,"pushed_at":"2021-01-27T20:16:55.000Z","size":2,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-19T20:59:36.616Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/rustyconover.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":"license.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-01-27T16:47:09.000Z","updated_at":"2024-09-30T20:02:40.000Z","dependencies_parsed_at":null,"dependency_job_id":"a4bdd20a-0f82-470b-a34a-3c329c189663","html_url":"https://github.com/rustyconover/reddit-recorder","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rustyconover%2Freddit-recorder","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rustyconover%2Freddit-recorder/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rustyconover%2Freddit-recorder/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rustyconover%2Freddit-recorder/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/rustyconover","download_url":"https://codeload.github.com/rustyconover/reddit-recorder/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245753874,"owners_count":20666827,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-30T07:07:37.547Z","updated_at":"2025-03-26T23:31:00.672Z","avatar_url":"https://github.com/rustyconover.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Reddit Listener\n\nListen to a subreddit's comments and submissions, serialize them to JSON\nand write them to S3 periodically based on either a time or size limit.\n\n## Requirements\n\nPython 3, a Reddit approved API key and secret.\n\n## Usage\n\n```\nusage: listener.py [-h] --subreddit SUBREDDIT [--flush-interval FLUSH_INTERVAL] [--flush-size FLUSH_SIZE] --s3-bucket S3_BUCKET --client-id CLIENT_ID --client-secret CLIENT_SECRET\n                   [--mode {comments,submissions}]\n\nListen to Reddit and save the comments or submissions to S3\n\noptional arguments:\n  -h, --help            show this help message and exit\n  --subreddit SUBREDDIT\n                        The subreddit to listen to\n  --flush-interval FLUSH_INTERVAL\n                        The maximum number of seconds between uploads to S3\n  --flush-size FLUSH_SIZE\n                        The maximum number of bytes before triggering a flush to S3\n  --s3-bucket S3_BUCKET\n                        The name of the S3 bucket where to store the captured data\n  --client-id CLIENT_ID\n                        The Reddit API client id\n  --client-secret CLIENT_SECRET\n                        The Reddit API client secret\n  --mode {comments,submissions}\n                        The type of post to save\n```","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frustyconover%2Freddit-recorder","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frustyconover%2Freddit-recorder","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frustyconover%2Freddit-recorder/lists"}