Projects in Awesome Lists tagged with jsonlines

https://github.com/thombashi/sqlitebiter

A CLI tool to convert CSV / Excel / HTML / JSON / Jupyter Notebook / LDJSON / LTSV / Markdown / SQLite / SSV / TSV / Google-Sheets to a SQLite database file.

cli-app converter csv excel google-sheets html json jsonlines jupyter-notebook ldjson ltsv ndjson sqlite tsv

Last synced: 15 May 2025

https://github.com/datacoon/undatum

undatum: a command-line tool for data processing. Brings CSV simplicity to NDJSON, BSON, XML and other data files

bson cli command-line csv data dataset json jsonl jsonlines parquet

Last synced: 18 Jan 2026

https://github.com/cheng-lin-li/knowledgegraph

This repository for Web Crawling, Information Extraction, and Knowledge Graph build up.

cdr conditional conditional-random-fields crfsuite facebook-crawler facebook-graph-api information-extraction jsonlines knowledge-graph python python3 web-crawling

Last synced: 09 Mar 2026

https://github.com/tpeczek/json-streaming-dotnet

JsonStreaming.NET is a solution that provides a set of libraries (`Ndjson.AsyncStreams.*`) for working with asynchronous streaming data sources over HTTP using JSONL (JSON Lines) and NDJSON (Newline Delimited JSON).

asp-net-core asp-net-core-mvc async-streams dotnet jsonl jsonlines ndjson

Last synced: 26 Oct 2025

https://github.com/meilisearch/meilisearch-importer

A CLI to import massive CSV and NdJson into Meilisearch

csv importer json jsonlines meilisearch ndjson

Last synced: 13 Jun 2025

https://github.com/umarbutler/orjsonl

A lightweight, high-performance Python library for parsing jsonl files.

bzip2 deserialization gzip json json-lines jsonl jsonlines ndjson parser parsing python serialization xz zstandard

Last synced: 11 Oct 2025

https://github.com/jwodder/serde-jsonlines

Read & write JSON Lines documents

available-on-crates-io json json-lines jsonlines rust serde serde-json

Last synced: 07 Apr 2025

https://github.com/salaah01/json-lineage

Tool to allow parsing large JSON files without laoding into memory. Developed in Rust with adapters in other programming langauges for easy adoption

json jsonl jsonlines python python3 rust rust-lang

Last synced: 21 Mar 2025

https://github.com/trisongz/pylines

Simplifying parsing of large jsonline files in NLP Workflows

json jsonlines jsonlines-data nlp-datasets

Last synced: 01 Sep 2025

https://github.com/kekyo/jsonstreamer

JSON Lines streaming serializer/deserializer on .NET and ASP.NET Core.

aspnetcore dotnet jsonlines jsonstreaming ndjson streaming

Last synced: 17 Jul 2025

https://github.com/dwinkler1/jsonlines.jl

JSONLines reader/writer for Julia

jsonlines julia julia-language julia-package julialang

Last synced: 11 Dec 2025

https://github.com/dwinkler1/JSONLines.jl

JSONLines reader/writer for Julia

jsonlines julia julia-language julia-package julialang

Last synced: 17 Aug 2025

https://github.com/busterc/fs-ndjson

:information_source: read and write NDJSON files (Newline Delimited JSON)

json jsonld jsonlines ldjson ndjson

Last synced: 29 Jul 2025

https://github.com/rmoralespp/jsonl

A lightweight Python library for handling jsonlines files

bzip2 deserialization files gzip json jsonl jsonlines ndjson python serialization tar utils xz zip

Last synced: 11 Mar 2026

https://github.com/winebarrel/jlsort

Sort JSON Lines using External merge sort

json jsonlines ndjson rust sort

Last synced: 18 Aug 2025

https://github.com/meltanolabs/target-jsonl-blob

JSONL Singer target for local storage, S3, GCS and Azure Blob Storage

blob-storage golang jsonlines singer-io

Last synced: 11 Apr 2025

https://github.com/unfoldml/jsonl

JSON Lines

json jsonl jsonlines jsonlines-data streaming-data

Last synced: 23 Apr 2025

https://github.com/busterc/ndjson-generate-schema

:information_source: Effortlessly convert your NDJSON data to a JSON Schema.

json-schema json-schema-generator jsonld jsonlines jsonschema ndjson

Last synced: 06 May 2025

https://github.com/busterc/vscode-ndjson-colorizer

:art: VSCode extension colorizes NDJSON (Newline Delimited JSON) files

colorize colorizer json-ld jsonld jsonlines ndjson vscode-extension vscode-language

Last synced: 03 Feb 2026

https://github.com/equalma/jsonlines

stringify / parse jsonlines for NodeJS using streams

json jsonlines nodejs parse stream stringify

Last synced: 20 Mar 2025

https://github.com/tilfin/jsonlines-processor

JSON Lines streaming processor for CLI

cli json-log jsonlines processor

Last synced: 30 Mar 2025

https://github.com/ascoderu/compression-benchmarks

Benchmark to compare serialization and compression algorithms

aes-encryption avro bson bzip2 cbor gzip jsonlines msgpack python3 sqlite xz zstandard

Last synced: 06 Oct 2025

https://github.com/aminnairi/cristaline

An immutable database engine built on the Event Sourcing pattern.

event event-sourcing javascript json jsonl jsonlines jsonstream react sourcing store typescript

Last synced: 04 Mar 2026

https://github.com/oada/cli

Pipeable OADA CLI client

cli client concatenated-json json jsonl jsonlines ldjson ndjson oada

Last synced: 17 Apr 2026

https://github.com/fumito-ito/swiftyjsonlines

The better way to deal with JSONLines data in Swift.

jsonl jsonlines swift swift6

Last synced: 27 Feb 2026

https://github.com/musichin/ktlint-jsonlines-reporter

ktlint JSON Lines reporter

jsonlines kotlin ktlint

Last synced: 17 Aug 2025

https://github.com/winebarrel/jljoin

Read two NDJSON files and combine lines with common member values.

json jsonlines ndjso rust

Last synced: 29 Apr 2026

https://github.com/neverendingqs/pprint-ndjson-ui

For pretty-printing newline delimited JSON.

jsonl jsonlines ndjson netlify react-bootstrap reactjs

Last synced: 08 May 2026

https://github.com/leodeveloper/fine-tune-with-google-cloud

Generative AI custom data fine tuning with google cloud vertax ai

aiplatform custom-data custom-dataset customdataset datasets datasets-csv fine-tuning gcp generative-ai google-cloud google-cloud-aiplatform jsonl jsonlines machine-learning python vertex-ai

Last synced: 24 Apr 2026

https://github.com/mrpudn/maltrends

(mirror) MyAnimeList.net manga and anime trend data.

anime data json jsonl jsonlines manga myanimelist

Last synced: 20 Apr 2026

https://github.com/kledenai/jsonweaver

A powerful and easy-to-use library for transforming JSON data into popular formats such as CSV, XML, Markdown tables, YAML, and JSONLines (NDJSON).

csv data data-transform format json jsonlines jsonweaver markdown markdown-tables xml yaml

Last synced: 24 Feb 2026

https://github.com/fracpete/gsonlines

Java library for reading/writing JSON lines data.

java jsonlines maven

Last synced: 27 Apr 2026

https://github.com/jpmikkers/delimit-json

Powershell function that splits text consisting of concatenated JSON objects into separate JSON chunks.

json jsonlines ndjson powershell structured-logging

Last synced: 02 May 2026

https://github.com/27escape/mqtt2jsonl

Record and replay MQTT messages sent to a particular topic. The messages are recorded to a JSONL (https://jsonlines.org/) file

cli jsonlines mqtt python python3 record recorder replay

Last synced: 05 May 2026

https://github.com/imkairat/flex_json

flex_json is a Python utility that converts JSON files into the JSON Lines (JSONL) format. It reads a standard JSON file, which typically contains a list or array of objects, and outputs a corresponding JSONL file where each object is written to a new line.

json jsonlines python

Last synced: 28 Apr 2026

https://github.com/benjajaja/rowfiles

Go library for reading files with rows (CSV, JSONLines, Parquet...)

csv go jsonlines parquet rowfiles rows

Last synced: 10 Mar 2026

https://github.com/fmind/jsonpipe

Demonstrate how to process jsonlines files in parallel with Clojure

clojure demonstration jsonlines parallel processing

Last synced: 19 May 2026

https://github.com/diegoperea20/clean-dataset-jsonlines

clean dataset jsonlines about store and sales with objective of create all needed transformations in order to get a clean dataset with the required features to train a machine learning model that predicts if a product is new or used.

csv ipynb jsonlines notebook python

Last synced: 18 May 2026