https://github.com/r007/rredditsocialmonitoring
A custom Reddit social monitoring script
https://github.com/r007/rredditsocialmonitoring
r reddit reddit-api reddit-crawler scraper scraping-websites
Last synced: 8 months ago
JSON representation
A custom Reddit social monitoring script
- Host: GitHub
- URL: https://github.com/r007/rredditsocialmonitoring
- Owner: r007
- Created: 2020-05-23T00:10:02.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2020-06-15T00:45:55.000Z (about 6 years ago)
- Last Synced: 2025-04-14T07:57:27.300Z (about 1 year ago)
- Topics: r, reddit, reddit-api, reddit-crawler, scraper, scraping-websites
- Language: R
- Size: 13.7 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# RRedditSocialMonitoring
This is the backend scraper script to monitor submissions with specific words or phrases. To see mentions the moment they're made. Tracker search all of Reddit by default.
## How it works?
It scraps every post from Reddit in real time. Reddit gets about 500,000 new posts and 4,000,000 new comments every day. Combined, that's about 50/second. The posts don't come in at a contant rate, though, so we'd better be able to handle a few hundred a second.
Reddit offers a nice JSON API. We'll just use that to grab the most recent posts. It's at https://www.reddit.com/r/all/new/.json, and I recommend you open that up in your browser to follow along.