{"id":13690326,"url":"https://github.com/pitops/reddit-bot-scraper","last_synced_at":"2025-06-14T04:37:45.632Z","repository":{"id":54258486,"uuid":"190014235","full_name":"pitops/reddit-bot-scraper","owner":"pitops","description":"Scrape subreddits based on search criteria or get the X latest from 'hot' or 'new' categories","archived":false,"fork":false,"pushed_at":"2021-03-01T03:50:56.000Z","size":18,"stargazers_count":27,"open_issues_count":2,"forks_count":4,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-04-01T18:09:52.696Z","etag":null,"topics":["puppeteer","reddit-bot"],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/pitops.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-06-03T13:47:42.000Z","updated_at":"2025-03-28T00:01:40.000Z","dependencies_parsed_at":"2022-08-13T10:10:53.222Z","dependency_job_id":null,"html_url":"https://github.com/pitops/reddit-bot-scraper","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/pitops/reddit-bot-scraper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pitops%2Freddit-bot-scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pitops%2Freddit-bot-scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pitops%2Freddit-bot-scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pitops%2Freddit-bot-scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/pitops","download_url":"https://codeload.github.com/pitops/reddit-bot-scraper/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pitops%2Freddit-bot-scraper/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":259761545,"owners_count":22907366,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["puppeteer","reddit-bot"],"created_at":"2024-08-02T16:01:03.094Z","updated_at":"2025-06-14T04:37:45.598Z","avatar_url":"https://github.com/pitops.png","language":"JavaScript","readme":"# Reddit Bot Scraper\n\n## Description\n\nThe motivation behind this bot is to showcase how you can create a reddit scraper bot. The application for this specific bot is to get the `hot` or `new` comments(topics) in a specific category.\n\nMoreover, it can be configured to search for specific keywords and bring only relevant results.\n\n## Setup\n\nOpen up `index.js` and configure the subreddit to scrape from. See examples below for various ways to use it.\n\nExample:\n\n```javascript\n// index.js\n\n// initialize(subreddit: String, options: Object)\n// if no options are passed it defaults to { headless: false, devtools: true}\n\nawait reddit.initialize(\"smallbusiness\", {\n  headless: false,\n  devtools: false\n});\n```\n\n### Usage Examples\n\n```javascript\n// Get latest 25 topics in specific subreddit\nconst results = await reddit.get();\n\n// Search the 'new' tab of subreddit and bring first 10 results\nconst results = await reddit.get({\n  type: \"new\",\n  number: 10\n});\n\n// Get up to 5 results\nconst results = await reddit.get({\n  limit: 5\n});\n\n// limit to 5 results matching keyword criteria\nconst results = await reddit.searchFor([\"reminder\", \"appointment\"]).get(5);\n\n// Same as above in a more verbose way\nconst results = await reddit\n  .searchFor([\"reminder\", \"appointment\"])\n  .get({ limit: 5 });\n\n// Get 100 topics and THEN filter by keywords\nconst results = await reddit.getLatest({\n  type: \"hot\",\n  number: 100,\n  keywords: [\"appointment\", \"reminder\"]\n});\n\n// Alias of .get()\nconst results = await reddit.getLatestHot();\n\n// Alias of .get() configured for the 'new' tab in Reddit\nconst results = await reddit.getLatestNew();\n```\n\n## Contributions welcome\n","funding_links":[],"categories":["Misc"],"sub_categories":["External Reddit Tools"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpitops%2Freddit-bot-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpitops%2Freddit-bot-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpitops%2Freddit-bot-scraper/lists"}