Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/ad-si/csvnorm
Command line tool to normalize CSV, TSV, and other *SV files
https://github.com/ad-si/csvnorm
cli csv normalize tsv typescript
Last synced: about 2 months ago
JSON representation
Command line tool to normalize CSV, TSV, and other *SV files
- Host: GitHub
- URL: https://github.com/ad-si/csvnorm
- Owner: ad-si
- Created: 2017-04-12T19:05:49.000Z (almost 8 years ago)
- Default Branch: master
- Last Pushed: 2022-03-01T20:56:25.000Z (almost 3 years ago)
- Last Synced: 2024-12-01T19:37:42.277Z (2 months ago)
- Topics: cli, csv, normalize, tsv, typescript
- Language: TypeScript
- Homepage:
- Size: 194 KB
- Stars: 6
- Watchers: 3
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
Awesome Lists containing this project
README
# Csvnorm
Command line tool to normalize CSV and \*SV files.
Steps:
- Convert to UTF-8 encoding
- Replace separator with `,`
- Reformat
- Date columns to ISO8601
- Number columns to `1456.25`
- Currency columns to `1539.16 $`
## CLI Version
### Installation
```sh
npm install --global csvnorm
```
```sh
yarn global add csvnorm
```
### Usage
```txt
Usage:
csvnorm [Options] INFILE [> OUTFILE]
csvnorm [Options] < INFILE [> OUTFILE]
Options:
--date-format Specify an additional prioritized input date format [string]
--encoding Overwrite detected input encoding [string]
--in-place Normalize CSV file in place [boolean] [default: false]
--iso-datetime Output datetimes with format YYYY-MM-DD[T]HH:mm:ss.SSS[Z]
[boolean] [default: false]
--skip-start Skip lines at the start of the input [number] [default: 0]
--version Show version number [boolean]
--help Show help [boolean]
Examples:
csvnorm input.csv > normalized.csv Normalize a CSV file
cat input.csv | csvnorm > normalized.csv Pipe and normalize a CSV file
csvnorm --date-format "dd/mm/yyyy" i.csv Normalize a CSV file with an unusual
date format
```
## Node Module
### Installation
```sh
npm install --save csvnorm
```
```sh
yarn add csvnorm
```
### Usage
With files:
```js
const csvnorm = require('csvnorm')
csvnorm({
filePath: csvFilePath,
inPlace: true,
})
```
With streams:
```js
const csvnorm = require('csvnorm')
csvnorm({
readableStream: process.stdin,
writableStream: process.stdout,
})
```
**Warning:**
Numbers from `1,000` to `999,999` with 3 decimal places
are parsed as floats (`1.000` to `999.999`).
Only numbers larger than `1,000,000`
or numbers with less or more than 3 decimal places
can be unambiguously parsed as integers (`1000000`).
### TODO
- [ ] Print debugging info in TTY mode
- [ ] Improve encoding detection
(e.g. fork and update https://github.com/finnp/to-utf-8)
- [ ] Implement `skipLinesEnd`