https://github.com/hellbus1/news_scrapper

https://github.com/hellbus1/news_scrapper

Last synced: about 1 month ago
JSON representation

• Host: GitHub
• URL: https://github.com/hellbus1/news_scrapper
• Owner: HellBus1
• Created: 2022-06-07T06:33:59.000Z (about 4 years ago)
• Default Branch: master
• Last Pushed: 2022-06-16T05:58:59.000Z (about 4 years ago)
• Last Synced: 2025-03-05T23:30:15.841Z (over 1 year ago)
• Language: Python
• Size: 840 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# News Scrapper

## How to Install

### News Scrapper

1. Setup virtual env

> virtualenv venv

2. Activate virtualenv

> . venv/bin/activate

3. Install requirements

> pip install -r requirements.txt

4. Init scrapy (if not exist)

> scrapy startproject scrapper

## How to Run

1. Go to project folder

> cd scrapper

2. Run this command

> scrapy crawl --nolog news

> scrapy crawl news