https://github.com/rajputpriyankaa/scrapy

Web scraping with Scrapy
https://github.com/rajputpriyankaa/scrapy

css-selectors scraping scrapy xpath

Last synced: 12 months ago
JSON representation

Web scraping with Scrapy

• Host: GitHub
• URL: https://github.com/rajputpriyankaa/scrapy
• Owner: rajputpriyankaa
• License: other
• Created: 2025-04-12T17:10:31.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2025-04-12T17:24:42.000Z (about 1 year ago)
• Last Synced: 2025-04-12T18:26:53.543Z (about 1 year ago)
• Topics: css-selectors, scraping, scrapy, xpath
• Language: Python
• Homepage: https://www.scrapingcourse.com/ecommerce/
• Size: 18.6 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# scrapy

Web scraping with Scrapy

# For starting the project, use command:

scrapy startproject 

Ex: scrapy startproject scrapingcourse

# Go to the created directory

cd scrapingcourse

# Generate a spider file

scrapy genspider scraper 

Ex: scrapy genspider scraper https://www.scrapingcourse.com/ecommerce/ 

It will create the scraper.py under spiders folder

# To run the scraper:

scrapy crawl scraper

# To output the data in json file:

scrapy crawl scraper -o json 

# To output the data in csv file:

scrapy crawl scraper -o scraper.csv