awesome-data-wrangling

A curated list of data wrangling resources
https://github.com/peerside/awesome-data-wrangling

Last synced: about 4 hours ago
JSON representation

Excel to CSV conversion
- xlsx2csv
- Excel Streaming Reader
- Apache POI
- Excelize
- GUI - of-orange.com/post/How-to-Convert-an-XSLX-File-to-CSV-with-UTF-8-Encoding-Using-LibreOffice-OpenOffice) to convert xlsx to CSV. Doesn't seem to handle passwords or multiple sheets in headless mode
Data Search/Filtering
- ripgrep
JSON Processing
- jq
Compression Tools
- - xz - purpose data compression software with a high compression ratio and parallel support.
  - lbzip2
- Data Prep Tools
  - visidata
- Process Orchestration
  - camunda
  - apache airflow
XML Processing
- xmlstarlet
PDF Processing
- blog here
Postal Address Processing
- intro post
Test Data Generation
- faker.js - cli)
- demo
- generatedata.com

Programming Languages

C 1 Rust 1 Java 1 Python 1

Categories

Compression Tools 5 Excel to CSV conversion 5 Test Data Generation 3 XML Processing 1 JSON Processing 1 Postal Address Processing 1 Data Search/Filtering 1 PDF Processing 1

Sub Categories

Process Orchestration 2 Data Prep Tools 1

Keywords

jq 1 search 1 rust 1 ripgrep 1 regex 1 recursively-search 1 grep 1 gitignore 1 command-line-tool 1 command-line 1 cli 1