https://github.com/gimnathperera/web-scraping-riyasewana.lk

Web scraping script written in python using scrapy library in order to scrape product data from popular Sri Lankan vehicle selling web sites.
https://github.com/gimnathperera/web-scraping-riyasewana.lk

crawler python scrapy spider webscraping

Last synced: 4 days ago
JSON representation

Web scraping script written in python using scrapy library in order to scrape product data from popular Sri Lankan vehicle selling web sites.

• Host: GitHub
• URL: https://github.com/gimnathperera/web-scraping-riyasewana.lk
• Owner: gimnathperera
• Created: 2020-01-29T07:41:42.000Z (almost 5 years ago)
• Default Branch: master
• Last Pushed: 2022-05-27T01:50:19.000Z (over 2 years ago)
• Last Synced: 2023-09-17T18:32:19.984Z (about 1 year ago)
• Topics: crawler, python, scrapy, spider, webscraping
• Language: Python
• Homepage:
• Size: 9.77 KB
• Stars: 9
• Watchers: 2
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# web-scraping-Riyasewana.lk

Web scraping script written in python using scrapy library in order to scrape product data from popular Sri Lankan vehicle selling web sites.

You can scrape the data by executing following commands

```python

scrapy crawl riyasewana -o riyasewana.json

```

Make sure you have installed scrapy in your virtual enviornment along with python 3.7

```bash

pip install scrapy

```