{"id":526,"url":"https://github.com/secretGeek/awesomeCSV","last_synced_at":"2025-08-13T19:33:52.505Z","repository":{"id":37514771,"uuid":"152835793","full_name":"secretGeek/AwesomeCSV","owner":"secretGeek","description":"🕶️A curated list of awesome tools for dealing with CSV.","archived":false,"fork":false,"pushed_at":"2024-04-27T23:05:32.000Z","size":79,"stargazers_count":660,"open_issues_count":20,"forks_count":55,"subscribers_count":20,"default_branch":"master","last_synced_at":"2024-05-23T07:29:10.217Z","etag":null,"topics":["awesome","awesome-list","csv","csv-converter","csv-data","csv-essays","csv-files","csv-json","csv-parser","csv-standards","csv-utilities"],"latest_commit_sha":null,"homepage":"","language":"PowerShell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"cc0-1.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/secretGeek.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"contributing.md","funding":null,"license":"license","code_of_conduct":"code-of-conduct.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-10-13T04:42:03.000Z","updated_at":"2024-05-21T02:48:36.000Z","dependencies_parsed_at":"2024-05-05T06:33:06.515Z","dependency_job_id":null,"html_url":"https://github.com/secretGeek/AwesomeCSV","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/secretGeek%2FAwesomeCSV","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/secretGeek%2FAwesomeCSV/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/secretGeek%2FAwesomeCSV/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/secretGeek%2FAwesomeCSV/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/secretGeek","download_url":"https://codeload.github.com/secretGeek/AwesomeCSV/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":229517413,"owners_count":18085488,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["awesome","awesome-list","csv","csv-converter","csv-data","csv-essays","csv-files","csv-json","csv-parser","csv-standards","csv-utilities"],"created_at":"2024-01-05T20:12:57.321Z","updated_at":"2025-08-13T19:33:52.484Z","avatar_url":"https://github.com/secretGeek.png","language":"PowerShell","funding_links":[],"categories":["Data Science","Miscellaneous","Technical","Uncategorized","Live Site:   [searchAwesome](https://search-awesome.vercel.app/)","其他","Other Lists","Data journalism practices","Themed Directories"],"sub_categories":["awesome-*","Uncategorized","TeX Lists","Data analysis","Updated in the last 6 months"],"readme":"# Awesome CSV [![Awesome](https://awesome.re/badge.svg)](https://awesome.re)\n\n**A carefully curated list of CSV-related tools and resources**\n\n[CSV](https://en.wikipedia.org/wiki/Comma-separated_values) remains the most futuristic data format from the distant past.\n\nXML has risen and fallen. JSON is just a flash in the pan. YAML is a poisoned chalice. **CSV will outlast them all.**\n\nWhen the final cockroach breathes her last breath, her dying act will be to scratch her date of death in a CSV file for posterity.\n\n\n## Contents\n\n- [Tools](#tools)\n  - [Repair or Validate CSV](#repair-or-validate-csv)\n  - [Treat CSV as SQL](#treat-csv-as-sql)\n  - [Convert to or from CSV](#convert-to-or-from-csv)\n  - [CSV \u003c-\u003e JSON](#csv---json)\n- [Essays](#essays)\n- [Data](#data)\n- [Conferences](#conferences)\n- [Standards](#standards)\n- [META: Other similar lists](#meta-other-similar-lists)\n- [Code of Conduct](#code-of-conduct)\n- [Funtribute](#funtribute)\n- [Footnotes](#footnotes)\n\n\n\nHere are some awesome tools for dealing with CSV:\n\n## Tools\n\n- [NimbleText/Live](https://NimbleText.com/Live) - Use patterns to manipulate CSV; the world's simplest code generator *.\n- [PapaParse](https://www.papaparse.com) - A powerful in-browser CSV parser.\n- [d3-dsv](https://github.com/d3/d3-dsv) - d3.js parser and formatter module for delimiter-separated values.\n- [CSVKit](https://csvkit.readthedocs.io/) - CSV utilities that includes csvsql / csvgrep / csvstat and more.\n- [QSV](https://github.com/dathere/qsv) - A fast CSV command-line toolkit written in Rust, (an update to xsv).\n- [sed (gnu tool)](https://www.gnu.org/software/sed/manual/sed.html) - Stream editor.\n- [gawk (gnu tool)](https://www.gnu.org/software/gawk/manual/gawk.html) - Text processing and data extraction using [awk](http://pubs.opengroup.org/onlinepubs/009695399/utilities/awk.html).\n- [awk by example](https://github.com/learnbyexample/Command-line-text-processing/blob/master/gnu_awk.md#default-field-separation) - Comprehensive examples of using awk.\n- [Miller](http://johnkerl.org/miller/doc/) - Like sed / awk / cut / join / sort etc for name-indexed data such as CSV.\n- [ParaText](https://github.com/wiseio/paratext) - CSV parsing at 2.5 GB per second.\n- [CSVGet](http://github.com/fizx/csvget/tree/master) - Get structured data from sites as CSV.\n- [CSVfix](https://code.google.com/p/csvfix/) - A tool for manipulating CSV data.\n- [Tad](https://www.tadviewer.com) - A fast free cross-platform CSV viewer.\n- [Nvd3-tags](http://blog.tryolabs.com/2015/02/27/nvd3-tags-a-tiny-library-for-making-charts-from-csv-data/) - A tiny library for making charts from csv data.\n- [Powershell: Import-CSV](https://docs.microsoft.com/en-us/powershell/module/microsoft.powershell.utility/import-csv) - Powerful in-built facility for dealing with CSV ([example](https://gist.github.com/dfinke/786ba9edae1b0265ada10b36a7a11ba9)).\n- [CSV Tools](https://onlinecsvtools.com/) - A collection of useful CSV utilities.\n- [graph-cli](https://github.com/mcastorina/graph-cli) - Flexible command line tool to create graphs from CSV data.\n- [CSV to SQL](http://www.convertcsv.com/csv-to-sql.htm) - Online tool to create insert/update/delete etc from CSV data.\n- [C#: kbCSV](https://github.com/kentcb/KBCsv/blob/master/README.md) - An efficient, easy to use .NET parsing and writing library for CSV.\n- [csvprintf](https://github.com/archiecobbs/csvprintf) - UNIX command line utility for parsing and formatting output based on CSV files.\n- [Ron's Data Edit](https://www.ronsplace.eu/Products/RonsDataEdit) (new modern version of [Ron's CSV Editor](https://www.ronsplace.eu/products/ronseditor)) - Handles big files, does miraculous things. A timeless editor for a timeless format.\n- [Rainbow CSV plugins](https://github.com/mechatroner/rainbow_csv#rainbow-csv-in-other-editors) - Collection of text editor plugins for CSV/TSV syntax highlighting. Available for [Vim](https://github.com/mechatroner/rainbow_csv), [VS Code](https://marketplace.visualstudio.com/items?itemName=mechatroner.rainbow-csv), [Atom](https://atom.io/packages/rainbow-csv), [Sublime Text](https://packagecontrol.io/packages/rainbow_csv) and other editors.\n- [ExtendsClass](https://extendsclass.com/csv-diff.html) - A simple CSV comparator.\n- [Mighty Merge](https://mightymerge.io/) - join/union csv files.\n- [Modern CSV](https://www.moderncsv.com/) - A tool for editing CSV files and viewing large files.\n- [Data Wrangler](https://github.com/microsoft/vscode-data-wrangler) - Data Wrangler is a code-centric data cleaning tool that is integrated into VS Code and VS Code Jupyter Notebooks.\n\n### Repair or Validate CSV\n\n- [Csvlint.go](https://github.com/Clever/csvlint) - Command line tool for validating CSV files against RFC 4180.\n- [csvstudio](http://www.csvstudio.com/) - A smart app to repair syntax errors in very large CSV files.\n- [scrubcsv](https://github.com/faradayio/scrubcsv) - Remove bad records from a CSV file and normalize (requires rust)\n- [reconcile-csv](https://github.com/OpenRefine/reconcile-csv/blob/master/README.md) - Find relationships between a set of related CSVs\n\n## Generate Table Schema\n\n- [CSV Schema](https://csv-schema.surge.sh/) \u0026mdash; Analyzes a CSV file and generates database table schema, all within the browser\n- Wanted: More tools in this category.\n\n\n### Treat CSV as SQL\n\n- [TextQL](http://dinedal.github.io/textql/) - Execute SQL against CSV or TSV.\n- [Datasette Facets](https://simonwillison.net/2018/May/20/datasette-facets/) - Faceted browse and a JSON API for any CSV File or SQLite DB.\n- [q](https://harelba.github.io/q/) - Run SQL Directly on CSV Files\n- [RBQL](https://rbql.org) - Rainbow Query Language, a SQL-like language with JavaScript or Python backend.\n- [PSKit Query](https://github.com/dfinke/PSKit#sql-query) \u0026mdash; Powershell module lets you run simple queries over objects, including imported with csv\n\n### Convert to or from CSV\n\n- [CSV to Table](https://github.com/vividvilla/csvtotable) - Convert CSV files to searchable and sortable HTML table.\n\n### CSV \u003c-\u003e JSON\n\n- [Agnes](http://www.secretgeek.net/agnes/twoWay.html) - Two way Csv to Json **.\n- [csv2json](https://www.csvjson.com/csv2json) - online tool to convert your CSV or TSV formatted data to JSON and [vice versa](https://www.csvjson.com/json2csv).\n- [csv-to-json](https://mango-is.com/tools/csv-to-json/) - Easy, privacy-friendly and offline-first online csv to json converter.\n\n\n## Essays\n\n\u003e Once you've found the perfect data serialization file format, you stop looking\n\u003e\n\u003e [David Wengier](https://twitter.com/davidwengier/status/1159606464220000257)\n\n\n- [Thinking about CSV](https://blog.datacite.org/thinking-about-csv/) - Martin Fenner.\n- [In Praise of CSV](https://usopendata.org/2015/03/10/csv) - Waldo Jaquith.\n- [Stop Rolling Your Own CSV Parser!](http://www.secretgeek.net/csv_trouble) - Leon Bambrick ***.\n- [So You Want To Write Your Own CSV code?](http://thomasburette.com/blog/2014/05/25/so-you-want-to-write-your-own-CSV-code/) - Thomas Burette.\n- [Falsehoods Programmers Believe About CSVs](https://donatstudios.com/Falsehoods-Programmers-Believe-About-CSVs) - Jesse Donat.\n- [ASCII Delimited Text - Not CSV or TAB delimited text](https://ronaldduncan.wordpress.com/2009/10/31/text-file-formats-ascii-delimited-text-not-csv-or-tab-delimited-text/) - Ronald Duncan.\n\n## Generate Data\n\n- [Fake Name Generator](https://www.fakenamegenerator.com/order.php) - Generate fake names with other identity data in bulk for testing.\n- [Mockium](https://softwium.com/mockium/) - Test data generator for CSV / JSON / SQL / XML.\n- [Mockaroo](https://www.mockaroo.com/) - Random data generator for CSV / JSON / SQL / Excel.\n\n\n## Data\n\n- [US Data.gov](https://catalog.data.gov/dataset?res_format=CSV) - 18789+ CSV datasets.\n- [Australian Government Open Data](https://data.gov.au/dataset?res_format=CSV) - 2715+ CSV datasets.\n- [Reference data in csv](https://datahub.io/collections/reference-data) - Easy-to-use reference data in CSV and JSON formats.\n- [awesome-public-datasets](https://github.com/awesomedata/awesome-public-datasets) - A topic-centric list of high-quality open datasets in public domains.\n- [United Nations data](https://data.un.org) - Data from the UN\n\n## Conferences\n\n- [csv,conf](https://csvconf.com/) - A community conference for data makers everywhere.\n\n\n## Standards\n\n\u003e The wonderful thing about standards is that there are so many of them to choose from.\u003cbr /\u003e\u0026mdash;(Possibly) Grace Hopper.\n\n- [RFC 4180](https://tools.ietf.org/html/rfc4180) ([html version](http://www.faqs.org/rfcs/rfc4180.html)) - \"*Common format and MIME Type for Comma-Separated Values (CSV) Files*\".\n  - [Definition of the CSV Format](https://tools.ietf.org/html/rfc4180#section-2)\n  - [MIME Type Registration of text/csv](https://tools.ietf.org/html/rfc4180#section-3)\n- [W3C: Model for Tabular Data and Metadata on the Web](https://www.w3.org/TR/tabular-data-model/)\n- [CSV Schema Language](http://digital-preservation.github.io/csv-schema/csv-schema-1.2.html) - A language for defining and validating CSV data.\n- [csv,specs](https://github.com/csvspecs) - Comma-Separated Values (CSV) Format Specifications (and Tests) incl. CSV v1.0, CSV v1.1, CSV Strict, CSV \u003c3 Numerics, CSV\u003c3 JSON, CSV \u003c3 YAML.\n- [Tabular Data Resource](http://frictionlessdata.io/specs/tabular-data-resource/) - A [Data Resource](http://frictionlessdata.io/specs/data-resource/) specialized for describing tabular data like CSV files or spreadsheets\n- [CSVY](https://github.com/csvy/csvy.github.io/blob/master/index.md) - A standard for adding a YAML header to CSV files to describe their format\n\n## META: Other similar lists\n\n- [structured-text-tools](https://github.com/dbohdan/structured-text-tools) - List of command line tools for manipulating CSV / XML / HTML / JSON / INI etc.\n- [META-META](https://raw.githubusercontent.com/secretGeek/AwesomeCSV/master/awesomecsv.csv) - **This list as CSV**.\n- [META-META-META](https://nimbletext.com/Live/-971009575/) - A NimbleText pattern that produces this markdown page from this list as a CSV.\n\n\n## Code of Conduct\n\nSee [Code of Conduct](code-of-conduct.md)\n\n\n## Funtribute\n\nTo experience the fun of contributing, see [Contributing](contributing.md)\n\n\n## Footnotes\n\n`*` \u003cspan id='footnote1' \u003e\u003c/span\u003e I'm the author of [NimbleText](https://NimbleText.com/Live). Of course I put it first on the list. If I didn't personally rate it I wouldn't have spent so much time making and improving it.\n\n`**` \u003cspan id='footnote2' \u003e\u003c/span\u003e I wrote `agnes` but don't particularly endorse it for others to use (thus haven't migrated the source code to GitHub). It's slow and non-streaming. I'd go with `papa-parse`. On the plus side, `agnes` has a more comprehensive test suite and simpler api than most.\n\n`***` \u003cspan id='footnote3' \u003e\u003c/span\u003e Mine too.\n\n## License\n\n[![CC0](http://mirrors.creativecommons.org/presskit/buttons/88x31/svg/cc-zero.svg)](https://creativecommons.org/publicdomain/zero/1.0/)\n\nTo the extent possible under law, [Leon Bambrick](http://secretgeek.net) has waived all copyright and related or neighboring rights to this work.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FsecretGeek%2FawesomeCSV","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FsecretGeek%2FawesomeCSV","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FsecretGeek%2FawesomeCSV/lists"}