https://github.com/anastasios3/webscrapper
https://github.com/anastasios3/webscrapper
Last synced: over 1 year ago
JSON representation
- Host: GitHub
- URL: https://github.com/anastasios3/webscrapper
- Owner: Anastasios3
- Created: 2024-05-27T20:09:18.000Z (about 2 years ago)
- Default Branch: master
- Last Pushed: 2024-05-31T20:01:21.000Z (about 2 years ago)
- Last Synced: 2024-05-31T21:24:43.566Z (about 2 years ago)
- Language: Python
- Size: 12.5 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Web Scraper Project
## Disclaimer
It needs more work.
## Overview
A web scraper built with Flask and SQLAlchemy for scraping and storing web data.
## Features
- User authentication
- Data scraping
- Data storage
## Requirements
- Python 3.8+
- See `requirements.txt` for full list
## Installation
1. **Clone the repository:**
```sh
git clone https://github.com/Anastasios3/webScrapper.git
cd webScrapper
Create a virtual environment:
python -m venv scraper_env
scraper_env\Scripts\activate # On Windows
source scraper_env/bin/activate # On Unix/macOS
Install dependencies:
pip install -r requirements.txt
Set up the database:
flask shell
>>> from app import db
>>> db.create_all()
>>> exit()
Usage
Run the app:
python run.py
Open in browser:
Navigate to http://127.0.0.1:5000/.
License
MIT License