Projects in Awesome Lists tagged with ndjson
A curated list of projects in awesome lists tagged with ndjson .
https://github.com/ashvardanian/stringzilla
Up to 10x faster strings for C, C++, Python, Rust, Swift & Go, leveraging NEON, AVX2, AVX-512, SVE, & SWAR to accelerate search, hashing, sort, edit distances, and memory ops 🦖
beautifulsoup common-crawl csv dataset html information-retrieval json laion ndjson parser pattern-recognition simd sorting-algorithms string string-manipulation string-matching string-parsing string-search substring
Last synced: 22 Apr 2025
https://github.com/ashvardanian/StringZilla
Up to 10x faster strings for C, C++, Python, Rust, Swift & Go, leveraging NEON, AVX2, AVX-512, SVE, & SWAR to accelerate search, hashing, sort, edit distances, and memory ops 🦖
beautifulsoup common-crawl csv dataset html information-retrieval json laion ndjson parser pattern-recognition simd sorting-algorithms string string-manipulation string-matching string-parsing string-search substring
Last synced: 23 Mar 2025
https://github.com/minio/simdjson-go
Golang port of simdjson: parsing gigabytes of JSON per second
golang-standard json-document json-files ndjson simdjson tape tape-format
Last synced: 22 Apr 2025
https://github.com/juancarlospaco/faster-than-requests
Faster requests on Python 3
curl cython download-file faster-than-requests high-performance http-requests ndjson open-data python python-library python-requests python3 requests-toolbelt requests3 scrapy speed urllib urllib3 web-scraper web-scraping
Last synced: 10 Apr 2025
https://github.com/thombashi/sqlitebiter
A CLI tool to convert CSV / Excel / HTML / JSON / Jupyter Notebook / LDJSON / LTSV / Markdown / SQLite / SSV / TSV / Google-Sheets to a SQLite database file.
cli-app converter csv excel google-sheets html json jsonlines jupyter-notebook ldjson ltsv ndjson sqlite tsv
Last synced: 07 Apr 2025
https://github.com/shipharbor/merry
:ocean::ocean::sailboat::ocean::ocean: - cute streaming API framework
batteries-included framework ndjson node small streams
Last synced: 16 Mar 2025
https://github.com/yoshuawuyts/merry
:ocean::ocean::sailboat::ocean::ocean: - cute streaming API framework
batteries-included framework ndjson node small streams
Last synced: 29 Dec 2024
https://github.com/Jsondb/jsondb-core
JsonDB a pure java database that stores its data as Json Files
encyption-support java java-database json-files jsondb mongodb-like ndjson xpath-queries
Last synced: 03 Apr 2025
https://github.com/H21lab/tsharkVM
tshark + ELK analytics virtual machine
analytics elasticsearch elk kibana logstash ndjson nids protocols tshark tshark-vm vagrant virtual-machine vm wireshark
Last synced: 21 Nov 2024
https://github.com/tpeczek/demo.ndjson.asyncstreams
Sample project for demonstrating how to use async streams and NDJSON to improve user experience by streaming JSON objects from server to client and client to server in .NET
asp-net-core asp-net-core-mvc async-streams dotnet fetch-api ndjson ndjson-stream streams-api
Last synced: 16 Dec 2024
https://github.com/tpeczek/Demo.Ndjson.AsyncStreams
Sample project for demonstrating how to use async streams and NDJSON to improve user experience by streaming JSON objects from server to client and client to server in .NET
asp-net-core asp-net-core-mvc async-streams dotnet fetch-api ndjson ndjson-stream streams-api
Last synced: 18 Apr 2025
https://github.com/vweevers/tabular-stream
Detects tabular data (spreadsheets, dsv or json, 20+ different formats) and emits normalized objects.
csv dsv json ndjson nodejs ods qpw spreadsheets stream sylk tabular-data tsv xls xlsx
Last synced: 09 Jan 2025
https://github.com/umarbutler/orjsonl
A lightweight, high-performance Python library for parsing jsonl files.
bzip2 deserialization gzip json json-lines jsonl jsonlines ndjson parser parsing python serialization xz zstandard
Last synced: 11 Apr 2025
https://github.com/tpeczek/Ndjson.AsyncStreams
Ndjson.AsyncStreams is a solution for working with asynchronous streaming data sources over HTTP using NDJSON (Newline Delimited JSON).
asp-net-core asp-net-core-mvc async-streams dotnet ndjson ndjson-stream
Last synced: 09 Apr 2025
https://github.com/tpeczek/ndjson.asyncstreams
Ndjson.AsyncStreams is a solution for working with asynchronous streaming data sources over HTTP using NDJSON (Newline Delimited JSON).
asp-net-core asp-net-core-mvc async-streams dotnet ndjson ndjson-stream
Last synced: 16 Dec 2024
https://github.com/timkuijsten/node-ld-jsonstream
Simple and secure newline delimited JSON stream parser
line-delimited-json ndjson nodejs
Last synced: 09 Apr 2025
https://github.com/knapply/tweetio
I/O, Transformation, and Analytical Routines for Twitter Data
cpp data-dump io knapply ndjson r rcpp rstats rtweet social-network stream tweet-networks tweets twitter twitter-data
Last synced: 14 Feb 2025
https://github.com/pushshift/zreader
Read compressed NDJSON .zst files easily
Last synced: 12 Nov 2024
https://github.com/madnight/ndjson-to-json
Converts NDJSON to JSON
convert json ndjson nodejs npm-package
Last synced: 21 Nov 2024
https://github.com/pushshift/parallel-ndjson-reader
Parallel NDJSON Reader for Python
json multiprocessing ndjson newline parallel parallel-processing python
Last synced: 12 Nov 2024
https://github.com/tpeczek/Lib.AspNetCore.Mvc.Ndjson
Lib.AspNetCore.Mvc.Ndjson is a library that provides support for NDJSON (Newline Delimited JSON) based structured data streaming to ASP.NET Core MVC
asp-net-core asp-net-core-mvc ndjson ndjson-stream
Last synced: 18 Apr 2025
https://github.com/kekyo/jsonstreamer
JSON Lines streaming serializer/deserializer on .NET and ASP.NET Core.
aspnetcore dotnet jsonlines jsonstreaming ndjson streaming
Last synced: 26 Mar 2025
https://github.com/andy-goryachev/accesspanelpublic
Access Panel (public repo)
encrypted-store file-manager json-logs json-viewer log-viewer log-visualization ndjson script-runner ssh-client terminal-emulator vnc vnc-viewer
Last synced: 12 Mar 2025
https://github.com/bserdar/jsonstream
Go library to deal with streaming JSON documents with line-delimited JSON (NDJSON), record separator-delimited JSON, concatenated JSON, and length-prefixed JSON
Last synced: 13 Apr 2025
https://github.com/sunaoka/ndjson
A PHP library to read and write NDJSON (Newline Delimited JSON) in low memory.
Last synced: 21 Mar 2025
https://github.com/busterc/ndjson-generate-schema
:information_source: Effortlessly convert your NDJSON data to a JSON Schema.
json-schema json-schema-generator jsonld jsonlines jsonschema ndjson
Last synced: 31 Mar 2025
https://github.com/azu/ndjson-to-json-text
Convert ndjson to json without JSON parsing.
browser convert javascript json ndjson node
Last synced: 13 Mar 2025
https://github.com/ryanramage/reduce-group
Reduce ldjson by group levels, much like couchdb
Last synced: 05 Apr 2025
https://github.com/idris-maps/ndjson-utils
Utilities to deal with ndjson data
Last synced: 20 Nov 2024
https://github.com/vweevers/detect-tabular
A stream that detects tabular data (spreadsheets, dsv or json) and yields objects.
csv dsv json ndjson nodejs ods qpw spreadsheets stream sylk tabular-data tsv xls xlsx
Last synced: 09 Jan 2025
https://github.com/busterc/vscode-ndjson-colorizer
:art: VSCode extension colorizes NDJSON (Newline Delimited JSON) files
colorize colorizer json-ld jsonld jsonlines ndjson vscode-extension vscode-language
Last synced: 17 Feb 2025
https://github.com/fabervitale/deno-ndjson
Read, write, parse and serialize new line delimited JSON in deno: http://ndjson.org/
Last synced: 07 Apr 2025
https://github.com/marvinwu/piper-cli
a simple cli wrapper to process ndjson using well known packages such as lodash,voca and others
Last synced: 17 Mar 2025
https://github.com/banyc/dfsql
SQL REPL/lib for Data Frames
cli csv data-analysis jsonl ndjson repl sql
Last synced: 19 Nov 2024
https://github.com/gabrielhora/streamer
Stream PostgreSQL queries using NDJSON
flask ndjson postgresql python python3
Last synced: 16 Mar 2025
https://github.com/seriousme/durable-data
Durable versions of Map and Set using an append log on disk.
Last synced: 28 Mar 2025
https://github.com/oada/cli
Pipeable OADA CLI client
cli client concatenated-json json jsonl jsonlines ldjson ndjson oada
Last synced: 22 Feb 2025
https://github.com/maxlath/ndjson-apply
apply a JS function to a stream of newline-delimited JSON
apply-function cli diff ndjson transformation
Last synced: 02 Mar 2025
https://github.com/boydjohnson/ndjson-spatial
Tools for working with ndjson, turning geojson into ndjson, spatial tools
ndjson spatial spatial-data-science
Last synced: 23 Feb 2025
https://github.com/awais-vteams/split-and-convert
Split file into multiple file and convert ndjson streaming to csv with in2csv tool. ndjson to csv.
csv-converter csvkit ndjson ndjson-stream shell-script splitting
Last synced: 26 Mar 2025
https://github.com/lookininward/data-formatter-demo
You have directories containing data files and specification files. The specification files describe the structure of the data files. Write an app that reads format definitions from specification files. Use these definitions to convert the parsed files to NDJSON files.
csv data demo files json ndjson python txt unittest
Last synced: 29 Mar 2025
https://github.com/javascript-studio/studio-emojilog
🌈 A pretty printer for the Studio Log format with emoji ✨
cli emoji logging ndjson node sourcemaps
Last synced: 27 Mar 2025
https://github.com/neverendingqs/pprint-ndjson-ui
For pretty-printing newline delimited JSON.
jsonl jsonlines ndjson netlify react-bootstrap reactjs
Last synced: 25 Feb 2025
https://github.com/resurfaceio/simulator
Simulate API calls and import into Resurface database
Last synced: 30 Mar 2025
https://github.com/wioniqle-q/tower-modelling
Data science
data data-science ndarray-odeint ndjson science
Last synced: 16 Mar 2025
https://github.com/hubgit/input-stream
Read data from a CSV or NDJSON file to a stream
Last synced: 12 Mar 2025
https://github.com/franky47/douze-prettify-logs
NDJSON prettifier for Pino logs generated by Douze
Last synced: 05 Apr 2025
https://github.com/joelmcdaniel/filter-s3-object-data
Filter s3 object data. Project for a cable TV company.
aws-s3 docker golang ndjson s3-buckets s3-select
Last synced: 27 Mar 2025
https://github.com/vogelino/hackernews-mentions
A hackernews mentions search script based on @nraboy's article:
crawling hacker-news mentions mongodb ndjson nodejs pipeline sentiment-analysis streaming through2 through2-filter tutorial
Last synced: 18 Mar 2025
https://github.com/hockulus/apple-privacy-report-converter
Easy Way to block In-App-Ads with Apple App Privacy Report - Made for PiHole
adblock appprivacyreport converter in-app-advertising ndjson php-tool php-tools pihole-ads-list pihole-blocklists self-hosted selfhosted webtool
Last synced: 20 Mar 2025
https://github.com/takanoriyanagitani/psplit-py
Programmable text file splitter
aggregate jsonl ldjson lines2files lines2line ndjson programmable python3 split text
Last synced: 20 Feb 2025
https://github.com/adamgibbons/oregon-choropleth
Choropleth of Oregon's population by county
census-data d3-geo maps ndjson oregon shapefiles topojson
Last synced: 22 Apr 2025
https://github.com/idris-maps/deno-ndjson
CLI tools for dealing with ndjson in Deno
Last synced: 14 Mar 2025
https://github.com/roblabs/make-latitude-longitude-lines
NPM script to generate latitude and longitude lines in GeoJSON format
geojson ndjson ndjson-filter ndjson-reduce node npm null-island
Last synced: 19 Feb 2025
https://github.com/wyl/es-libr
Reduce reported data and optimize Elasticsearch response speed
elasticsearch koa koa-body mongo ndjson
Last synced: 25 Mar 2025
https://github.com/takanoriyanagitani/jsonl2jsons
convert jsonl(ldjson, ndjson, json-stream, ...) to json(s)
c json json-stream jsonl jsons ldjson ndjson
Last synced: 20 Feb 2025
https://github.com/koumoul-dev/mime-type-stream
Streaming parser + serializer for various mime-types
csv json ndjson parser serializer stream
Last synced: 14 Apr 2025
https://github.com/derhuerst/vbb-graph
Berlin & Brandenburg public transport as JSON graph.
berlin graph json ndjson public-transport transit transport vbb
Last synced: 20 Feb 2025
https://github.com/mrizaln/octave-ndjson
Newline Delimited JSON (ndjson) or JSON Lines (jsonl) parser for Octave
json jsonl multithreading ndjson octave parser
Last synced: 11 Mar 2025
https://github.com/winebarrel/jluniq
Remove duplicate key member lines from sorted NDJSON.
Last synced: 28 Mar 2025
https://github.com/leolabs/read-json-log
A Deno script that allows you to view JSON logs in a more readable manner
Last synced: 15 Mar 2025
https://github.com/rmoralespp/jsonl
A simple Python library for handling jsonlines files
bzip2 deserialization files gzip json jsonl jsonlines ndjson python serialization utils xz
Last synced: 11 Apr 2025
https://github.com/codewithkyle/ndjson-prototype
Exploring NDJSON response streams
demo ndjson prototype response-stream
Last synced: 15 Mar 2025
https://github.com/jpmikkers/delimit-json
Powershell function that splits text consisting of concatenated JSON objects into separate JSON chunks.
json jsonlines ndjson powershell structured-logging
Last synced: 30 Mar 2025
