Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/masonicboom/csvsplit
csvsplit splits large CSV files (tested with 1bn+ rows) without breaking up rows that contain newlines within quoted fields.
https://github.com/masonicboom/csvsplit
csv
Last synced: about 2 months ago
JSON representation
csvsplit splits large CSV files (tested with 1bn+ rows) without breaking up rows that contain newlines within quoted fields.
- Host: GitHub
- URL: https://github.com/masonicboom/csvsplit
- Owner: masonicboom
- License: mit
- Created: 2020-10-29T00:00:44.000Z (over 4 years ago)
- Default Branch: master
- Last Pushed: 2020-11-02T20:25:31.000Z (about 4 years ago)
- Last Synced: 2023-03-11T05:01:24.518Z (almost 2 years ago)
- Topics: csv
- Language: Go
- Homepage:
- Size: 10.7 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# csvsplit
## Description
`csvsplit` splits CSV files. Unlike the unix `split` command, `csvsplit` will not split a single CSV row across two files if that row has a newline embedded within a quoted field.
## Usage
1. Clone this repo.
1. `go build`.
1. `./csvsplit --line-bytes=MAX_BYTES_PER_FILE < FILE_TO_SPLIT.csv`.## Demo
Run `make demo` to see a comparison of `split` and `csvsplit`.