Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/petykowski/sql-script-generator
CSVtoSQL is a utility to generate different SQL scripts by referencing .csv files.
https://github.com/petykowski/sql-script-generator
python-3 scripting sql
Last synced: 8 days ago
JSON representation
CSVtoSQL is a utility to generate different SQL scripts by referencing .csv files.
- Host: GitHub
- URL: https://github.com/petykowski/sql-script-generator
- Owner: petykowski
- Created: 2016-11-10T23:37:22.000Z (about 8 years ago)
- Default Branch: master
- Last Pushed: 2017-02-25T23:57:02.000Z (almost 8 years ago)
- Last Synced: 2024-11-11T19:26:46.358Z (2 months ago)
- Topics: python-3, scripting, sql
- Language: Python
- Homepage:
- Size: 19.5 KB
- Stars: 1
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# CSVtoSQL
CSVtoSQL is a utility to generate different SQL scripts from data in .csv files.
## Output
```SQL
INSERT INTO city (ID, Name, CountryCode, District, Population) VALUES (1, 'Kabul', 'AFG', 'Kabol', 1780000);
INSERT INTO city (ID, Name, CountryCode, District, Population) VALUES (2, 'Qandahar', 'AFG', 'Qandahar', 237500);
COMMIT;
```
## Setup
1. Install Python version 3.0 or later.
2. Clone (or download) the CSVtoSQL repository to your working directory.
```Shell
git clone https://github.com/spetykowski/sql-script-generator.git
```
## Usage
```Shell
python csvtosql.py INSERT -t TABLENAME -f path/to/file.csv
```
### CSV Format
The first row of the csv should exactly match the column name of the target table.
```
ID,Name,CountryCode,District,Population
1,'Kabul','AFG','Kabol',1780000
2,'Qandahar','AFG','Qandahar',237500
```
### Filename
The filename should exactly match that of the SQL table where the generated script will be used. If you would like to define a table name that is different from the filename use the `-t` flag.
### Supported Data Types
```
String = 'String'
Integer = 1
Decimal = 12.55
Date = TO_DATE('2017/02/06', 'yyyy/mm/dd')
```
### Parameters
CSVtoSQL has a total of 5 parameters (2 required and 3 optional) available.
```
command {INSERT, MERGE} | (required) INSERT will convert the contents of a csv file(s) to SQL INSERT statement(s). MERGE will convert multiple SQL files into one comprehensive script.
-c, --commit | (optional) Use this flag to prohibit CSVtoSQL from appending "COMMIT;" to the end of the SQL script.
-f, --filepath | (required) Path to csv file (for single file process) or directory with multiple csv files (for batch process).
-l, --last | (optional) Used to limit the number of records returned. Will return only the last `n` records.
-t, --table | (optional) The SQL table where the data will be manipulated. (Default: Table Name = Filename without extention)
```
## Examples
**via Terminal:**
```Shell
python csvtosql.py INSERT -f example/SQL_SAMPLE.csv
```
```SQL
INSERT INTO SQL_SAMPLE (ID, Name, CountryCode, District, Population) VALUES (1, 'Kabul', 'AFG', 'Kabol', 1780000);
INSERT INTO SQL_SAMPLE (ID, Name, CountryCode, District, Population) VALUES (2, 'Qandahar', 'AFG', 'Qandahar', 237500);
...
INSERT INTO SQL_SAMPLE (ID, Name, CountryCode, District, Population) VALUES (9, 'Eindhoven', 'NLD', 'Noord-Brabant', 201843);
INSERT INTO SQL_SAMPLE (ID, Name, CountryCode, District, Population) VALUES (10, 'Tilburg', 'NLD', 'Noord-Brabant', 193238);
COMMIT;
```
**via Powershell:**
```Shell
python csvtosql.py INSERT -f .\example\SQL_SAMPLE.csv
```
```SQL
INSERT INTO SQL_SAMPLE (ID, Name, CountryCode, District, Population) VALUES (1, 'Kabul', 'AFG', 'Kabol', 1780000);
INSERT INTO SQL_SAMPLE (ID, Name, CountryCode, District, Population) VALUES (2, 'Qandahar', 'AFG', 'Qandahar', 237500);
...
INSERT INTO SQL_SAMPLE (ID, Name, CountryCode, District, Population) VALUES (9, 'Eindhoven', 'NLD', 'Noord-Brabant', 201843);
INSERT INTO SQL_SAMPLE (ID, Name, CountryCode, District, Population) VALUES (10, 'Tilburg', 'NLD', 'Noord-Brabant', 193238);
COMMIT;
```
**Define Table Name:**
```Shell
python csvtosql.py INSERT -f example/SQL_SAMPLE.csv -t city
```
```SQL
INSERT INTO city (ID, Name, CountryCode, District, Population) VALUES (1, 'Kabul', 'AFG', 'Kabol', 1780000);
INSERT INTO city (ID, Name, CountryCode, District, Population) VALUES (2, 'Qandahar', 'AFG', 'Qandahar', 237500);
...
INSERT INTO city (ID, Name, CountryCode, District, Population) VALUES (9, 'Eindhoven', 'NLD', 'Noord-Brabant', 201843);
INSERT INTO city (ID, Name, CountryCode, District, Population) VALUES (10, 'Tilburg', 'NLD', 'Noord-Brabant', 193238);
COMMIT;
```
**Generate Last 2 Rows and Skip Commit Command:**
```Shell
python csvtosql.py INSERT -f example/SQL_SAMPLE.csv -l 2 -c
```
```SQL
INSERT INTO SQL_SAMPLE (ID, Name, CountryCode, District, Population) VALUES (9, 'Eindhoven', 'NLD', 'Noord-Brabant', 201843);
INSERT INTO SQL_SAMPLE (ID, Name, CountryCode, District, Population) VALUES (10, 'Tilburg', 'NLD', 'Noord-Brabant', 193238);
```
**Generate Multiple INSERT Files From Folder:**
```Shell
python csvtosql.py INSERT -f example/batch_insert/
```
```
output-city.sql
output-country.sql
output-countrylanguage.sql
```
**Merge SQL Files to a Single Script:**
```Shell
python3 csvtosql.py MERGE -f example/merge/
```
```SQL
/* output-city.sql */
INSERT INTO city (ID, Name, CountryCode, District, Population) VALUES (1, 'Kabul', 'AFG', 'Kabol', 1780000);
...
INSERT INTO city (ID, Name, CountryCode, District, Population) VALUES (10, 'Tilburg', 'NLD', 'Noord-Brabant', 193238);
/* output-country.sql */
INSERT INTO country (ID, Code, Name, Continent, Region) VALUES (1, 'ABW', 'Aruba', 'North America', 'Caribbean');
...
INSERT INTO country (ID, Code, Name, Continent, Region) VALUES (10, 'ARM', 'Armenia', 'Asia', 'Middle East');
/* output-countrylanguage.sql */
INSERT INTO countrylanguage (ID, CountryCode, Language, IsOfficial) VALUES (1, 'ABW', 'Dutch', 'T');
...
INSERT INTO countrylanguage (ID, CountryCode, Language, IsOfficial) VALUES (10, 'AGO', 'Ambo', 'F');
COMMIT;
```