https://github.com/hamidzr/scratch-scraper
crawl and scrape public scratch projects for projects and more!
https://github.com/hamidzr/scratch-scraper
Last synced: 3 months ago
JSON representation
crawl and scrape public scratch projects for projects and more!
- Host: GitHub
- URL: https://github.com/hamidzr/scratch-scraper
- Owner: hamidzr
- Created: 2018-12-16T20:42:12.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2019-01-08T19:09:36.000Z (over 6 years ago)
- Last Synced: 2025-01-21T00:45:43.676Z (5 months ago)
- Language: Python
- Homepage: https://scratch.mit.edu
- Size: 41 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Scratch Scraper
Scraper for public Scratch projects.
Implements two different scrapers:
1. JS based simplistic scraper w/o a good spider
2. Py based using Scrapy w/ a spider## TODO
- [ ] grab user details (followers, shared projects, account age, etc)
- [ ] grab user's public projects
- [ ] project details
- [ ] comments (count)
- [ ] remixes [link](https://scratch.mit.edu/projects/228443539/remixes/)