https://github.com/prybalko/scraper
Web scraper
https://github.com/prybalko/scraper
Last synced: 3 months ago
JSON representation
Web scraper
- Host: GitHub
- URL: https://github.com/prybalko/scraper
- Owner: prybalko
- Created: 2020-05-12T14:32:03.000Z (about 5 years ago)
- Default Branch: master
- Last Pushed: 2020-05-15T15:51:34.000Z (about 5 years ago)
- Last Synced: 2025-01-06T21:26:43.317Z (5 months ago)
- Language: HTML
- Homepage: https://scraper.home.kg/posts/
- Size: 23.4 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Scraper
This is an application that parses [Hacker News](https://news.ycombinator.com/) website and stores top 30 posts.
Data can be retrieved using GET `/posts` endpoint.## Deployment
docker-compose up -d app
## Tests
pip install pipenv
pipenv install --dev
pipenv run pytest