https://github.com/koldyr/csvpumper

Tool to pump data from DB to CSV and from CSV to DB. Multiple tables in multiple threads
https://github.com/koldyr/csvpumper

csv csv-export csv-import database kotlin mssqlserver multithreading oracle postgresql

Last synced: 18 days ago
JSON representation

Tool to pump data from DB to CSV and from CSV to DB. Multiple tables in multiple threads

• Host: GitHub
• URL: https://github.com/koldyr/csvpumper
• Owner: koldyr
• Created: 2018-03-07T09:41:04.000Z (almost 7 years ago)
• Default Branch: master
• Last Pushed: 2023-08-15T08:40:13.000Z (over 1 year ago)
• Last Synced: 2024-12-04T02:07:48.115Z (18 days ago)
• Topics: csv, csv-export, csv-import, database, kotlin, mssqlserver, multithreading, oracle, postgresql
• Language: Kotlin
• Homepage:
• Size: 110 KB
• Stars: 1
• Watchers: 2
• Forks: 1
• Open Issues: 3
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# CSVPumper

**Tool to pump data from DB to CSV and from CSV to DB.** 

May be used as second step of DB migration:

1. You need to create same DB schema in target DB

1. Run this tool to load data

Main advantage of this tool: multiple tables support. Useful when you need load data from >10 tables to dedicated CSV files for future loading it to another DB with same schema.

If schema has complex foreign keys, developer should handle it manually: disable/delete them and enable/create afterwords.   

Will read file with tables list and export/import data in parallel. Number of threads are configurable so you can quite fast work with quite big schemas and huge tables up to 2 bil records.