https://github.com/alysivji/reddit-top-posts-scrapy

Scrape top posts from list of subreddits and insert into MongoDB
https://github.com/alysivji/reddit-top-posts-scrapy

mongodb reddit scraping scrapy

Last synced: 8 months ago
JSON representation

Scrape top posts from list of subreddits and insert into MongoDB

• Host: GitHub
• URL: https://github.com/alysivji/reddit-top-posts-scrapy
• Owner: alysivji
• Created: 2017-01-28T19:17:45.000Z (over 9 years ago)
• Default Branch: master
• Last Pushed: 2017-04-01T14:19:17.000Z (about 9 years ago)
• Last Synced: 2025-04-19T05:13:47.940Z (about 1 year ago)
• Topics: mongodb, reddit, scraping, scrapy
• Language: Python
• Homepage: https://alysivji.github.io/mongodb-pipelines-in-scrapy.html
• Size: 14.6 KB
• Stars: 15
• Watchers: 0
• Forks: 3
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Scraping Websites into MongoDB using Scrapy Pipelines

[Blog post about this project](https://alysivji.github.io/mongodb-pipelines-in-scrapy.html)