https://github.com/viktorholk/subreddit-scraper

📒 Scrape multiple subreddits and store them in a JSON format
https://github.com/viktorholk/subreddit-scraper

reddit reddit-api scraper subreddits

Last synced: 12 days ago
JSON representation

📒 Scrape multiple subreddits and store them in a JSON format

• Host: GitHub
• URL: https://github.com/viktorholk/subreddit-scraper
• Owner: viktorholk
• Created: 2020-09-24T06:01:38.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2020-09-24T06:36:50.000Z (over 4 years ago)
• Last Synced: 2024-10-25T06:00:21.564Z (2 months ago)
• Topics: reddit, reddit-api, scraper, subreddits
• Language: Python
• Homepage:
• Size: 6.84 KB
• Stars: 1
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Subreddit Scraper

📒 Scrape multiple subreddits and store them in a JSON format


🔖 Edit the posts with the built-in editor

## How to use

# Scraper

Clone the repository on your computer and open up a terminal.

Execute the program with ``python app.py``, this will scrape the subreddits in the list of the source code.
 Feel free to change these subreddits to whatever.


You can also type ``python app.py [count]`` (example ``python app 15``) - This will scrape 15 posts in each of the subreddits and store them in the json.

# Editor

To edit all the files you just scraped type ``python app -e`` pr ``python app --editor`` to open the editor.




![image of editor](https://i.imgur.com/qoKEhRR.png)

Here you can press SPACE to edit the content of the post, blacklist it with ESC which will remove it and prevent appending on other scrapes, U to open the url of the body (if it's a url) and Q to quit the editor.