https://github.com/alysivji/reddit-top-posts-scrapy
Scrape top posts from list of subreddits and insert into MongoDB
https://github.com/alysivji/reddit-top-posts-scrapy
mongodb reddit scraping scrapy
Last synced: 8 months ago
JSON representation
Scrape top posts from list of subreddits and insert into MongoDB
- Host: GitHub
- URL: https://github.com/alysivji/reddit-top-posts-scrapy
- Owner: alysivji
- Created: 2017-01-28T19:17:45.000Z (over 9 years ago)
- Default Branch: master
- Last Pushed: 2017-04-01T14:19:17.000Z (about 9 years ago)
- Last Synced: 2025-04-19T05:13:47.940Z (about 1 year ago)
- Topics: mongodb, reddit, scraping, scrapy
- Language: Python
- Homepage: https://alysivji.github.io/mongodb-pipelines-in-scrapy.html
- Size: 14.6 KB
- Stars: 15
- Watchers: 0
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Scraping Websites into MongoDB using Scrapy Pipelines
[Blog post about this project](https://alysivji.github.io/mongodb-pipelines-in-scrapy.html)