Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/masonicboom/csvsplit

csvsplit splits large CSV files (tested with 1bn+ rows) without breaking up rows that contain newlines within quoted fields.
https://github.com/masonicboom/csvsplit

csv

Last synced: about 2 months ago
JSON representation

csvsplit splits large CSV files (tested with 1bn+ rows) without breaking up rows that contain newlines within quoted fields.

Awesome Lists containing this project

README

        

# csvsplit

## Description

`csvsplit` splits CSV files. Unlike the unix `split` command, `csvsplit` will not split a single CSV row across two files if that row has a newline embedded within a quoted field.

## Usage

1. Clone this repo.
1. `go build`.
1. `./csvsplit --line-bytes=MAX_BYTES_PER_FILE < FILE_TO_SPLIT.csv`.

## Demo

Run `make demo` to see a comparison of `split` and `csvsplit`.