https://github.com/gauff/belgianelectriccarmarketanalyser
Python tool for analyzing the belgian second hand electric car market by scraping and visualizing data from multiple car listing websites. Features parallel web scraping, price tracking, and interactive dashboards.
https://github.com/gauff/belgianelectriccarmarketanalyser
automotive beautifulsoup4 car-market dash data-analysis-python data-cleaning data-visualization electric-vehicles market-analysis pandas parallel-processing plotly price-comparison price-monitoring selenium web-scraping-python
Last synced: 3 months ago
JSON representation
Python tool for analyzing the belgian second hand electric car market by scraping and visualizing data from multiple car listing websites. Features parallel web scraping, price tracking, and interactive dashboards.
- Host: GitHub
- URL: https://github.com/gauff/belgianelectriccarmarketanalyser
- Owner: Gauff
- Created: 2024-11-10T15:09:06.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2024-11-10T15:48:58.000Z (7 months ago)
- Last Synced: 2025-01-21T14:47:46.658Z (5 months ago)
- Topics: automotive, beautifulsoup4, car-market, dash, data-analysis-python, data-cleaning, data-visualization, electric-vehicles, market-analysis, pandas, parallel-processing, plotly, price-comparison, price-monitoring, selenium, web-scraping-python
- Language: Python
- Homepage:
- Size: 1.14 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Second hand electric car belgian market analyzer
A Python application for analyzing the second hand electric car belgian market by scraping and visualizing data from various car listing websites.
## Features
- Scrapes electric car listings from multiple sources (Autoscout24, 2ememain, Gocar)
- Cleans and normalizes data
- Provides interactive visualizations
- Real-time data updates
## Setup
1. Clone the repository
2. Install requirements:
```bash
pip install -r requirements.txt
```
3. Create a .env file with your API tokens (use .env.example as a template):
```
GOCAR_BEARER_TOKEN=your_token_here
```
4. Run the application:
```bash
python main.py
```
## Configuration
The application uses a central config.py file for managing paths and settings. The following directories will be created automatically:
- results/ (for storing scraped data)
- visualizations/ (for storing generated plots)
- logs/ (for application logs)
## Directory Structure
```
electric-car-market-analyzer/
│
├── src/
│ ├── sites/
│ │ ├── autoscout24/
│ │ ├── deuxieme_main/
│ │ └── gocar/
│ ├── data/
│ └── visualization/
│
├── results/
├── logs/
├── config.py
├── logging_config.py
├── main.py
└── requirements.txt
```
## Logging
The application uses Python's logging module for all output. Logs are stored in the logs/ directory and are also output to the console.
## License
MIT License
## Contributing
Pull requests are welcome. Please make sure to update tests as appropriate.