https://github.com/aman-dutta/tutsplus

A web scraper which would scrape a website using a web-crawler and scrapy-crawler
https://github.com/aman-dutta/tutsplus

scrapy-crawler splash web-crawler

Last synced: 3 months ago
JSON representation

A web scraper which would scrape a website using a web-crawler and scrapy-crawler

• Host: GitHub
• URL: https://github.com/aman-dutta/tutsplus
• Owner: aman-dutta
• Created: 2020-05-08T12:50:14.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2020-05-08T13:33:24.000Z (about 5 years ago)
• Last Synced: 2025-01-16T02:24:27.719Z (4 months ago)
• Topics: scrapy-crawler, splash, web-crawler
• Language: Python
• Homepage:
• Size: 14.6 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# tutsplus

One of the Dynamic Website scraping exercise

## Prequisites

A running Python and Scrapy installation is mandatory for this project. Additionally, a running Splash container has to be started via Docker before running the example. Therefore, a valid Docker installation is required for running the exercise.