https://github.com/shinasnp/parallel-csv2pg
Efficiently process and load large CSV datasets into PostgreSQL using parallel processing and multithreading in Python. This repository contains scripts for generating random data and seamlessly uploading it to PostgreSQL with optimal performance.
https://github.com/shinasnp/parallel-csv2pg
concurrent-processes csv data-processing database multithreading performance-optimization postgresql python
Last synced: about 2 months ago
JSON representation
Efficiently process and load large CSV datasets into PostgreSQL using parallel processing and multithreading in Python. This repository contains scripts for generating random data and seamlessly uploading it to PostgreSQL with optimal performance.
- Host: GitHub
- URL: https://github.com/shinasnp/parallel-csv2pg
- Owner: shinasnp
- Created: 2024-01-11T08:28:21.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-01-11T08:55:00.000Z (about 2 years ago)
- Last Synced: 2024-02-02T22:55:12.496Z (about 2 years ago)
- Topics: concurrent-processes, csv, data-processing, database, multithreading, performance-optimization, postgresql, python
- Language: Python
- Homepage:
- Size: 4.88 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0