https://github.com/saboye/extract-transform-load-weather-data

ETL (extract, transform, load) pipeline project that involves extracting data from flat files, manipulating and organizing the data through a series of transformation steps, and loading the resulting data into an SQLite database.
https://github.com/saboye/extract-transform-load-weather-data

etl etl-job etl-pipeline python sqlite

Last synced: 2 months ago
JSON representation

ETL (extract, transform, load) pipeline project that involves extracting data from flat files, manipulating and organizing the data through a series of transformation steps, and loading the resulting data into an SQLite database.

• Host: GitHub
• URL: https://github.com/saboye/extract-transform-load-weather-data
• Owner: saboye
• License: mit
• Created: 2021-08-07T11:11:40.000Z (almost 5 years ago)
• Default Branch: main
• Last Pushed: 2021-08-18T04:56:47.000Z (almost 5 years ago)
• Last Synced: 2025-06-17T21:43:53.280Z (about 1 year ago)
• Topics: etl, etl-job, etl-pipeline, python, sqlite
• Language: Python
• Homepage:
• Size: 399 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          


### 
Extract Transform Load Weather Data


![GitHub contributors](https://img.shields.io/github/contributors/saboye/Extract-Transform-Load-Weather-Data?color=blue&logo=github&style=for-the-badge)

![GitHub forks](https://img.shields.io/github/forks/saboye/Extract-Transform-Load-Weather-Data?logo=github&style=for-the-badge)

![GitHub issues](https://img.shields.io/github/issues-raw/saboye/Extract-Transform-Load-Weather-Data?style=for-the-badge)

![GitHub](https://img.shields.io/github/license/saboye/Extract-Transform-Load-Weather-Data?style=for-the-badge)

![GitHub last commit](https://img.shields.io/github/last-commit/saboye/Extract-Transform-Load-Weather-Data?style=for-the-badge)






  

    

  

  
ETL


  


    project description

    


    Explore the docs »

    


    


    View Demo

    ·

    Report Bug

    ·

    Request Feature

  


### Table of contents

1. [About The Project](#About_The_Project)

2. [Installation](#Installation)

3. [Schema](#Schema)

4. [Data Wearhouse demo](#Data_Wearhouse_demo)

5. [License](#License)

6. [Contact]("#Contact")

7. [Acknowledgements](#Acknowledgements)

### About The Project 

In this project, I create an ETL pipeline that extracts data from flat files and transforms and loads it into an SQLite database.  The project tasks need to define the data warehouse Schema for a particular analytic use.  

### Installation 

1. requirement  

```py

pip install pysqlite

```

2, 

```sh

git clone https://github.com/saboye/Extract-Transform-Load-Weather-Data.git

```

### Schema 

```sql

CREATE TABLE IF NOT EXISTS weather (

    day DATE,	    -- day of measurements

    min_temp FLOAT, -- min temperature in Fahrenheit

    max_temp FLOAT, -- max temperature in Fahrenheit

    snow INTEGETR   -- snow in inches

);

CREATE INDEX IF NOT EXISTS weather_day ON weather(day);

```

### Data Wearhouse demo

To see or to make a SQL query, After downloading please drag and drop the `weather.db` to https://db.samuelaboye.dev/

![](images/Sample_SQL.jpg)

### License 

Distributed under the MIT License. See [LICENSE](https://github.com/saboye/Extract-Transform-Load-Weather-Data/blob/master/LICENSE.txt) for more information.

### Contact 

Your Name - [@saboye](https://twitter.com/saboye1) 

Project Link: [https://github.com/saboye/Extract-Transform-Load-Weather-Data](https://github.com/saboye/Extract-Transform-Load-Weather-Data)

### Acknowledgements 

* [https://www.postgresql.org/](https://www.postgresql.org/)

* [https://www.antwak.com/](https://www.antwak.com/)

* [https://www.postgresqltutorial.com/](https://www.postgresqltutorial.com/)