https://github.com/stdevteam/test_scrapy
https://github.com/stdevteam/test_scrapy
Last synced: 9 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/stdevteam/test_scrapy
- Owner: stdevteam
- Created: 2018-12-05T17:53:51.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2022-04-05T12:31:22.000Z (about 4 years ago)
- Last Synced: 2025-07-05T03:11:56.762Z (12 months ago)
- Language: Python
- Size: 13.7 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
#Scrapy Demo
install dependencies
```
sudo apt-get install python3 python3-dev
sudo apt-get install python-dev python-pip libxml2-dev libxslt1-dev zlib1g-dev libffi-dev libssl-dev
pip install --user pipenv
pipenv install --ignore-pipfile
```
Run spider
```
pipenv run scrapy crawl coles -a urls=,
```
Example
```
pipenv run scrapy crawl coles -a urls=https://www.coles.com.au/
```