https://github.com/quocduyenanhnguyen/california-gas-prices

In this project, I scrapped data from a website to collect different types of gas data and their prices in California.
https://github.com/quocduyenanhnguyen/california-gas-prices

csv-files data-analytics data-cleaning data-visualization gas-prices mysql python3 tableau tableau-dashboards tableau-public

Last synced: 9 days ago
JSON representation

In this project, I scrapped data from a website to collect different types of gas data and their prices in California.

• Host: GitHub
• URL: https://github.com/quocduyenanhnguyen/california-gas-prices
• Owner: quocduyenanhnguyen
• License: mit
• Created: 2024-06-13T04:03:48.000Z (7 months ago)
• Default Branch: main
• Last Pushed: 2024-06-14T05:41:22.000Z (7 months ago)
• Last Synced: 2024-11-08T21:13:14.504Z (2 months ago)
• Topics: csv-files, data-analytics, data-cleaning, data-visualization, gas-prices, mysql, python3, tableau, tableau-dashboards, tableau-public
• Language: Python
• Homepage:
• Size: 66.4 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Software I used:

[MySQL Workbench](https://dev.mysql.com/downloads/workbench/): to write SQL 

[PyCharm CE](https://www.jetbrains.com/pycharm/download/?section=windows): to run Python script to scrap gas data

# Description: 

- I explored http://www.californiagasprices.com website to collect and analyze gas data. I came up with questions and then answered them.

- Data will be analyzed from Jun 6, 2024 to Jun 12, 2024. The data from the CSV files are refreshed daily using scheduling tool (i.e. Cron Job)

- Attached to this repository is my SQL queries and output/explanation of output, Python script to scrap data from the website, another Python script to delete any old CSV files that are older than 90 days, and 4 CSV files (Regular Gas, Midgrade Gas, Premium Gas, Diesel Fuel Gas)

- Link to Tableau viz: https://public.tableau.com/app/profile/anna.quoc.nguyen/viz/CaliforniaGasPricesfromJun62024toJun122024/Dashboard1