Projects in Awesome Lists tagged with ndjson
A curated list of projects in awesome lists tagged with ndjson .
https://github.com/ashvardanian/stringzilla
Up to 10x faster strings for C, C++, Python, Rust, Swift & Go, leveraging NEON, AVX2, AVX-512, SVE, & SWAR to accelerate search, hashing, sort, edit distances, and memory ops 🦖
beautifulsoup common-crawl csv dataset html information-retrieval json laion ndjson parser pattern-recognition simd sorting-algorithms string string-manipulation string-matching string-parsing string-search substring
Last synced: 11 May 2025
https://github.com/ashvardanian/StringZilla
Up to 10x faster strings for C, C++, Python, Rust, Swift & Go, leveraging NEON, AVX2, AVX-512, SVE, & SWAR to accelerate search, hashing, sort, edit distances, and memory ops 🦖
beautifulsoup common-crawl csv dataset html information-retrieval json laion ndjson parser pattern-recognition simd sorting-algorithms string string-manipulation string-matching string-parsing string-search substring
Last synced: 23 Mar 2025
https://github.com/minio/simdjson-go
Golang port of simdjson: parsing gigabytes of JSON per second
golang-standard json-document json-files ndjson simdjson tape tape-format
Last synced: 14 May 2025
https://github.com/juancarlospaco/faster-than-requests
Faster requests on Python 3
curl cython download-file faster-than-requests high-performance http-requests ndjson open-data python python-library python-requests python3 requests-toolbelt requests3 scrapy speed urllib urllib3 web-scraper web-scraping
Last synced: 14 May 2025
https://github.com/thombashi/sqlitebiter
A CLI tool to convert CSV / Excel / HTML / JSON / Jupyter Notebook / LDJSON / LTSV / Markdown / SQLite / SSV / TSV / Google-Sheets to a SQLite database file.
cli-app converter csv excel google-sheets html json jsonlines jupyter-notebook ldjson ltsv ndjson sqlite tsv
Last synced: 15 May 2025
https://github.com/shipharbor/merry
:ocean::ocean::sailboat::ocean::ocean: - cute streaming API framework
batteries-included framework ndjson node small streams
Last synced: 16 Mar 2025
https://github.com/jsondb/jsondb-core
JsonDB a pure java database that stores its data as Json Files
encyption-support java java-database json-files jsondb mongodb-like ndjson xpath-queries
Last synced: 11 Jan 2026
https://github.com/Jsondb/jsondb-core
JsonDB a pure java database that stores its data as Json Files
encyption-support java java-database json-files jsondb mongodb-like ndjson xpath-queries
Last synced: 03 Apr 2025
https://github.com/H21lab/tsharkVM
tshark + ELK analytics virtual machine
analytics elasticsearch elk kibana logstash ndjson nids protocols tshark tshark-vm vagrant virtual-machine vm wireshark
Last synced: 12 Jul 2025
https://github.com/duriantaco/jonq
Query JSON with SQL-like syntax. A readable jq alternative that generates pure jq under the hood. Table, CSV, YAML output. Interactive REPL. Pipes from curl, streams NDJSON logs.
cli command-line-tools csv data-extraction jq jq-alternative json json-parser json-processor json-query log-analysis ndjson python sql yaml
Last synced: 29 Apr 2026
https://github.com/tpeczek/Demo.Ndjson.AsyncStreams
Sample project for demonstrating how to use async streams and NDJSON to improve user experience by streaming JSON objects from server to client and client to server in .NET
asp-net-core asp-net-core-mvc async-streams dotnet fetch-api ndjson ndjson-stream streams-api
Last synced: 18 Apr 2025
https://github.com/tpeczek/demo.ndjson.asyncstreams
Sample project for demonstrating how to use async streams and NDJSON to improve user experience by streaming JSON objects from server to client and client to server in .NET
asp-net-core asp-net-core-mvc async-streams dotnet fetch-api ndjson ndjson-stream streams-api
Last synced: 15 Aug 2025
https://github.com/vweevers/tabular-stream
Detects tabular data (spreadsheets, dsv or json, 20+ different formats) and emits normalized objects.
csv dsv json ndjson nodejs ods qpw spreadsheets stream sylk tabular-data tsv xls xlsx
Last synced: 30 Apr 2025
https://github.com/tpeczek/json-streaming-dotnet
JsonStreaming.NET is a solution that provides a set of libraries (`Ndjson.AsyncStreams.*`) for working with asynchronous streaming data sources over HTTP using JSONL (JSON Lines) and NDJSON (Newline Delimited JSON).
asp-net-core asp-net-core-mvc async-streams dotnet jsonl jsonlines ndjson
Last synced: 26 Oct 2025
https://github.com/pushshift/zreader
Read compressed NDJSON .zst files easily
Last synced: 02 May 2025
https://github.com/meilisearch/meilisearch-importer
A CLI to import massive CSV and NdJson into Meilisearch
csv importer json jsonlines meilisearch ndjson
Last synced: 13 Jun 2025
https://github.com/tpeczek/ndjson.asyncstreams
Ndjson.AsyncStreams is a solution for working with asynchronous streaming data sources over HTTP using NDJSON (Newline Delimited JSON).
asp-net-core asp-net-core-mvc async-streams dotnet ndjson ndjson-stream
Last synced: 14 Oct 2025
https://github.com/umarbutler/orjsonl
A lightweight, high-performance Python library for parsing jsonl files.
bzip2 deserialization gzip json json-lines jsonl jsonlines ndjson parser parsing python serialization xz zstandard
Last synced: 11 Oct 2025
https://github.com/tpeczek/Ndjson.AsyncStreams
Ndjson.AsyncStreams is a solution for working with asynchronous streaming data sources over HTTP using NDJSON (Newline Delimited JSON).
asp-net-core asp-net-core-mvc async-streams dotnet ndjson ndjson-stream
Last synced: 09 Apr 2025
https://github.com/timkuijsten/node-ld-jsonstream
Simple and secure newline delimited JSON stream parser
line-delimited-json ndjson nodejs
Last synced: 09 Apr 2025
https://github.com/knapply/tweetio
I/O, Transformation, and Analytical Routines for Twitter Data
cpp data-dump io knapply ndjson r rcpp rstats rtweet social-network stream tweet-networks tweets twitter twitter-data
Last synced: 03 Sep 2025
https://github.com/madnight/ndjson-to-json
Converts NDJSON to JSON
convert json ndjson nodejs npm-package
Last synced: 12 Jul 2025
https://github.com/pushshift/parallel-ndjson-reader
Parallel NDJSON Reader for Python
json multiprocessing ndjson newline parallel parallel-processing python
Last synced: 02 May 2025
https://github.com/tpeczek/Lib.AspNetCore.Mvc.Ndjson
Lib.AspNetCore.Mvc.Ndjson is a library that provides support for NDJSON (Newline Delimited JSON) based structured data streaming to ASP.NET Core MVC
asp-net-core asp-net-core-mvc ndjson ndjson-stream
Last synced: 18 Apr 2025
https://github.com/kekyo/jsonstreamer
JSON Lines streaming serializer/deserializer on .NET and ASP.NET Core.
aspnetcore dotnet jsonlines jsonstreaming ndjson streaming
Last synced: 17 Jul 2025
https://github.com/andy-goryachev/accesspanelpublic
Access Panel (public repo)
encrypted-store file-manager json-logs json-viewer log-viewer log-visualization ndjson script-runner ssh-client terminal-emulator vnc vnc-viewer
Last synced: 18 Oct 2025
https://github.com/aasaam/nginx-error-log-parser
Simple tool for parse and create structured JSON for Nginx error logs
error-log errorlog json naxsi ndjson nginx nginx-errors parsing structured-logging syslog
Last synced: 24 Jul 2025
https://github.com/amrfaissal/ex_ndjson
Implementation of Newline Delimited JSON (NDJSON) for Elixir
elixir-lang erlang-otp json ndjson ndjson-spec
Last synced: 21 Feb 2026
https://github.com/bserdar/jsonstream
Go library to deal with streaming JSON documents with line-delimited JSON (NDJSON), record separator-delimited JSON, concatenated JSON, and length-prefixed JSON
Last synced: 13 Apr 2025
https://github.com/sunaoka/ndjson
A PHP library to read and write NDJSON (Newline Delimited JSON) in low memory.
Last synced: 21 Mar 2025
https://github.com/rmoralespp/jsonl
A lightweight Python library for handling jsonlines files
bzip2 deserialization files gzip json jsonl jsonlines ndjson python serialization tar utils xz zip
Last synced: 11 Mar 2026
https://github.com/busterc/ndjson-generate-schema
:information_source: Effortlessly convert your NDJSON data to a JSON Schema.
json-schema json-schema-generator jsonld jsonlines jsonschema ndjson
Last synced: 06 May 2025
https://github.com/idris-maps/ndjson-utils
Utilities to deal with ndjson data
Last synced: 09 Jul 2025
https://github.com/ryanramage/reduce-group
Reduce ldjson by group levels, much like couchdb
Last synced: 02 Jul 2026
https://github.com/fabervitale/deno-ndjson
Read, write, parse and serialize new line delimited JSON in deno: http://ndjson.org/
Last synced: 08 Feb 2026
https://github.com/vweevers/detect-tabular
A stream that detects tabular data (spreadsheets, dsv or json) and yields objects.
csv dsv json ndjson nodejs ods qpw spreadsheets stream sylk tabular-data tsv xls xlsx
Last synced: 05 Mar 2026
https://github.com/busterc/vscode-ndjson-colorizer
:art: VSCode extension colorizes NDJSON (Newline Delimited JSON) files
colorize colorizer json-ld jsonld jsonlines ndjson vscode-extension vscode-language
Last synced: 03 Feb 2026
https://github.com/azu/ndjson-to-json-text
Convert ndjson to json without JSON parsing.
browser convert javascript json ndjson node
Last synced: 13 Mar 2025
https://github.com/shahradelahi/undici-extra
🌊 Elegant HTTP client for Node.js based on Undici with extra features
dedup fetch hooks http-client ndjson nodejs pagination proxy retry undici
Last synced: 15 Feb 2026
https://github.com/maxlath/ndjson-apply
apply a JS function to a stream of newline-delimited JSON
apply-function cli diff ndjson transformation
Last synced: 02 Mar 2025
https://github.com/marvinwu/piper-cli
a simple cli wrapper to process ndjson using well known packages such as lodash,voca and others
Last synced: 17 Jul 2025
https://github.com/laphilosophia/strime
Streaming projection engine — extract fields at multi-gigabit speeds with O(1) memory
data-extraction data-processing fsm high-performance json json-parser json-streaming ndjson parser projection streaming typescript zero-copy
Last synced: 15 Feb 2026
https://github.com/woozymasta/logz
Server-side DayZ mod that implements structured logging (NDJSON) for advanced server analytics and monitoring
dayz dayz-mod enforce-script logging monitoring ndjson observability structured-logging
Last synced: 04 Mar 2026
https://github.com/oada/cli
Pipeable OADA CLI client
cli client concatenated-json json jsonl jsonlines ldjson ndjson oada
Last synced: 17 Apr 2026
https://github.com/gabrielhora/streamer
Stream PostgreSQL queries using NDJSON
flask ndjson postgresql python python3
Last synced: 21 Apr 2026
https://github.com/seriousme/durable-data
Durable versions of Map and Set using an append log on disk.
Last synced: 25 Apr 2026
https://github.com/floatpane/go-uds-jsonrpc
Tiny newline-delimited JSON-RPC over Unix domain sockets, for Go.
background-service daemon go golang golang-library ipc json-lines json-rpc jsonrpc ndjson pidfile pubsub rpc server-push single-instance uds unix-domain-sockets unix-sockets xdg zero-dependencies
Last synced: 22 Jun 2026
https://github.com/madgodinc/mgi-pulse
Terminal log viewer in Rust. 11 formats, regex extraction, native --follow, timeline scrub, query DSL.
cli command-line-tool journalctl log-analysis log-parser log-viewer logfmt logs ndjson ratatui rust structured-logging syslog terminal tui
Last synced: 04 Jun 2026
https://github.com/wioniqle-q/tower-modelling
Data science
data data-science ndarray-odeint ndjson science
Last synced: 16 Mar 2025
https://github.com/mbe24/99problems
AI-native CLI tool for issue/PR context retrieval across Jira, GitLab, GitHub, and Bitbucket, with structured output for humans and AI agents plus a scaffold aligned with the Agent Skills standard.
agent-skills agentic-engineering ai-agents ai-native bitbucket-cloud bitbucket-datacenter cli developer-tools github-api gitlab-api issue-tracking jira-api json jsonl llm ndjson pull-requests rag rust yaml
Last synced: 13 Apr 2026
https://github.com/alibpowell/survey-intake-api
A lightweight backend API I built to collect, validate, deduplicate, and store survey responses in NDJSON format as a backend development experiment.
api flask idempotency logging ndjson pydantic python rest
Last synced: 20 Apr 2026
https://github.com/awais-vteams/split-and-convert
Split file into multiple file and convert ndjson streaming to csv with in2csv tool. ndjson to csv.
csv-converter csvkit ndjson ndjson-stream shell-script splitting
Last synced: 26 Mar 2025
https://github.com/hubgit/input-stream
Read data from a CSV or NDJSON file to a stream
Last synced: 29 Jun 2026
https://github.com/boydjohnson/ndjson-spatial
Tools for working with ndjson, turning geojson into ndjson, spatial tools
ndjson spatial spatial-data-science
Last synced: 10 Oct 2025
https://github.com/lookininward/data-formatter-demo
You have directories containing data files and specification files. The specification files describe the structure of the data files. Write an app that reads format definitions from specification files. Use these definitions to convert the parsed files to NDJSON files.
csv data demo files json ndjson python txt unittest
Last synced: 27 Apr 2026
https://github.com/blauwers/export-azloganalytics
Azure Log Analytics or Sentinel tables into compressed NDJSON using adaptive binning with retry logic.
automation azure exporter gzip loganalytics microsoftse mit-license ndjson powershell
Last synced: 30 Apr 2026
https://github.com/javascript-studio/studio-emojilog
🌈 A pretty printer for the Studio Log format with emoji ✨
cli emoji logging ndjson node sourcemaps
Last synced: 17 Apr 2026
https://github.com/neverendingqs/pprint-ndjson-ui
For pretty-printing newline delimited JSON.
jsonl jsonlines ndjson netlify react-bootstrap reactjs
Last synced: 08 May 2026
https://github.com/resurfaceio/simulator
Simulate API calls and import into Resurface database
Last synced: 30 Mar 2025
https://github.com/banyc/dfsql
SQL REPL/lib for Data Frames
cli csv data-analysis jsonl ndjson repl sql
Last synced: 31 Jul 2025
https://github.com/vogelino/hackernews-mentions
A hackernews mentions search script based on @nraboy's article:
crawling hacker-news mentions mongodb ndjson nodejs pipeline sentiment-analysis streaming through2 through2-filter tutorial
Last synced: 09 May 2026
https://github.com/derhuerst/vbb-graph
Berlin & Brandenburg public transport as JSON graph.
berlin graph json ndjson public-transport transit transport vbb
Last synced: 24 Apr 2026
https://github.com/roblabs/make-latitude-longitude-lines
NPM script to generate latitude and longitude lines in GeoJSON format
geojson ndjson ndjson-filter ndjson-reduce node npm null-island
Last synced: 09 May 2026
https://github.com/idris-maps/deno-ndjson
CLI tools for dealing with ndjson in Deno
Last synced: 28 Apr 2026
https://github.com/leolabs/read-json-log
A Deno script that allows you to view JSON logs in a more readable manner
Last synced: 17 May 2026
https://github.com/takanoriyanagitani/psplit-py
Programmable text file splitter
aggregate jsonl ldjson lines2files lines2line ndjson programmable python3 split text
Last synced: 19 Jun 2025
https://github.com/codewithkyle/ndjson-prototype
Exploring NDJSON response streams
demo ndjson prototype response-stream
Last synced: 15 Mar 2025
https://github.com/oxcone1/tet-offer-map
Interactive React+Vite map visualizing Tet (Latvia) internet availability from scraped OSM addresses (NDJSON)
fusejs geojson latvia leaflet localforage mapping ndjson overpass-turbo puppeteer react shadcn tailwindcss tet vite
Last synced: 13 Apr 2026
https://github.com/franky47/douze-prettify-logs
NDJSON prettifier for Pino logs generated by Douze
Last synced: 05 Apr 2025
https://github.com/cristiano-atlasos/aos-evidence-export-packs
Evidence export packs — NDJSON & OpenTelemetry mappings plus starter queries for Splunk and Microsoft Sentinel (SIEM/GRC ingest).
evidence exports governance ndjson opentelemetry security sentinel siem splunk
Last synced: 03 Jul 2026
https://github.com/winebarrel/jluniq
Remove duplicate key member lines from sorted NDJSON.
Last synced: 12 Apr 2026
https://github.com/wyl/es-libr
Reduce reported data and optimize Elasticsearch response speed
elasticsearch koa koa-body mongo ndjson
Last synced: 13 Apr 2026
https://github.com/xonoxitron/ebpf-sentinel
Linux kernel security: Rust eBPF probes, scalable telemetry (NDJSON/gRPC), MITRE ATT&CK detection-as-code, and Claude-powered SOAR triage tuned for ML workloads.
aya detection-engineering ebpf edr endpoint-detection file-integrity-monitoring grpc linux-kernel-security ml-infrastructure-security ndjson process-lineage reverse-shell-detection siem soar telemetry-pipeline tracepoints
Last synced: 24 Jun 2026
https://github.com/hockulus/apple-privacy-report-converter
Easy Way to block In-App-Ads with Apple App Privacy Report - Made for PiHole
adblock appprivacyreport converter in-app-advertising ndjson php-tool php-tools pihole-ads-list pihole-blocklists self-hosted selfhosted webtool
Last synced: 20 Mar 2025
https://github.com/sdkks/nesdit
nesdit aka NestedEdit: Edit and convert your json(l),yaml,toml files in place or on the fly through streaming
ansible argo argocd configuration jq json jsonl kubernetes ndjson serialization spinnaker toml yaml yml yq
Last synced: 01 Jun 2026
https://github.com/adamgibbons/oregon-choropleth
Choropleth of Oregon's population by county
census-data d3-geo maps ndjson oregon shapefiles topojson
Last synced: 07 Feb 2026
https://github.com/koumoul-dev/mime-type-stream
Streaming parser + serializer for various mime-types
csv json ndjson parser serializer stream
Last synced: 30 Jun 2026
https://github.com/joelmcdaniel/filter-s3-object-data
Filter s3 object data. Take home exercise project for a cable TV company. They got an entirely free solution and didn't even hire me. One of the reasons I try to avoid these free work type of interview take home projects now.
aws-s3 docker golang ndjson s3-buckets s3-select
Last synced: 29 Apr 2026
https://github.com/jpmikkers/delimit-json
Powershell function that splits text consisting of concatenated JSON objects into separate JSON chunks.
json jsonlines ndjson powershell structured-logging
Last synced: 02 May 2026
https://github.com/sebastian-software/ferrocat
Performance-first Rust toolkit for Gettext PO and NDJSON catalogs, merge workflows, and ICU MessageFormat-aware localization.
benchmarking gettext i18n icu-messageformat localization ndjson parser po-files rust translation
Last synced: 21 May 2026
