https://github.com/thujuli/etl-csv2postgres
ETL from CSV File to OLAP Database
https://github.com/thujuli/etl-csv2postgres
Last synced: 9 months ago
JSON representation
ETL from CSV File to OLAP Database
- Host: GitHub
- URL: https://github.com/thujuli/etl-csv2postgres
- Owner: thujuli
- Created: 2023-10-23T12:43:52.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2023-10-23T13:13:39.000Z (over 2 years ago)
- Last Synced: 2025-03-27T15:49:56.784Z (about 1 year ago)
- Language: Jupyter Notebook
- Homepage:
- Size: 6.53 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## ETL Process from CSV to PostgreSQL Database
This README serves as a summary of the ETL (Extract, Transform, Load) process for moving data from a CSV file into a PostgreSQL database. For a comprehensive explanation and implementation details, please refer to the associated [Medium article](https://medium.com/@thujuli/mastering-etl-integrating-csv-data-into-an-olap-database-with-pandas-60de05604ea9).
### Instructions
**Extract Data**: The tool or library used for this purpose is Pandas, to read and extract data from the CSV file.
**Transform Data**: Modify and shape the extracted data as needed for your specific use case, for example, data type conversions, data validation, or filtering.
**Load Data**: Establish a connection to your PostgreSQL database, create a table to match your data, and insert the transformed data into the table using SQL statements.