https://github.com/hellbus1/geographical_news_scrapper
https://github.com/hellbus1/geographical_news_scrapper
Last synced: 13 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/hellbus1/geographical_news_scrapper
- Owner: HellBus1
- Created: 2021-11-29T03:19:53.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2022-06-30T06:03:33.000Z (almost 4 years ago)
- Last Synced: 2025-01-16T10:11:07.176Z (over 1 year ago)
- Language: Jupyter Notebook
- Size: 465 MB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Geographical News Scrapper
Geographical news scrapper is a project that scrap news for specific category (eg: disaster, sports, criminality, economy etc) and plot the news into map where the news is happen.
## Progress
1. Mainstream News Scrapping (detik), it can iterate through pagination
## How to Install
### News Scrapper
1. Setup virtual env
> virtualenv venv
3. Activate virtualenv
> . venv/bin/activate
4. Install requirements
> pip install -r requirements.txt
## How to Run
### Scrapper
1. Go to project folder
> cd scrapper/mainstream
2. Run this command
> scrapy crawl --nolog news