Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with zero-copy

A curated list of projects in awesome lists tagged with zero-copy .

https://github.com/apache/fory

A blazingly fast multi-language serialization framework for idiomatic domain objects, schema IDL, and cross-language data exchange.

compression cpp cross-language encoding fast golang hacktoberfest java javascript jit lightning marshalling multiple-language persistence python rpc rust serialization transfer zero-copy

Last synced: 21 May 2026

https://github.com/rkyv/rkyv

Zero-copy deserialization framework for Rust

rust serialization zero-copy

Last synced: 15 Jan 2026

https://github.com/apache/fury

A blazingly fast multi-language serialization framework powered by JIT and zero-copy.

compression cpp cross-language encoding fast golang hacktoberfest java javascript jit lightning marshalling multiple-language persistence python rpc rust serialization transfer zero-copy

Last synced: 12 May 2025

https://github.com/sanshengshui/netty-learning-example

:egg: Netty实践学习案例，见微知著！带着你的心，跟着教程。我相信你行欧。

fastjson http im iot kafka mqtt netty protobuf rpc zero-copy

Last synced: 15 May 2025

https://github.com/google/zerocopy

Zerocopy makes zero-cost memory manipulation effortless. We write `unsafe` so you don’t have to.

memory memory-safety performance rust zero-copy

Last synced: 18 Apr 2026

https://github.com/betwixt-labs/bebop

🎷No ceremony, just code. Blazing fast, typesafe binary serialization.

c-sharp compiler cpp dart deserialization javascript json marshalling real-time rpc rust serialization typescript zero-copy

Last synced: 13 May 2025

https://github.com/felixguendling/cista

Cista is a simple, high-performance, zero-copy C++ serialization & reflection library.

benchmark cpp cpp17 deserialization efficient high-performance reflection serialization zero-copy

Last synced: 14 May 2025

https://github.com/eclipse-iceoryx/iceoryx2

Eclipse iceoryx2™ - true zero-copy inter-process-communication in pure Rust

eclipse iceoryx inter-process-communication ipc middleware publish-subscribe pubsub request-response rpc rust shared-memory zero-copy

Last synced: 13 May 2025

https://github.com/marwes/combine

A parser combinator library for Rust

parser parser-combinators rust zero-copy

Last synced: 12 Dec 2025

https://github.com/Marwes/combine

A parser combinator library for Rust

parser parser-combinators rust zero-copy

Last synced: 14 Mar 2025

https://github.com/fastserial/lite3

A JSON-Compatible Zero-Copy Serialization Format

binary c json schemaless serialization serialization-format serialization-library zero-copy

Last synced: 24 Jun 2026

https://github.com/acln0/zerocopy

Zero-copy I/O primitives and pipelines for Go. Linux-specific.

go linux pipelines splice tee zero-copy

Last synced: 04 Apr 2025

https://github.com/cloudflare/mmap-sync

Rust library for concurrent data access, using memory-mapped files, zero-copy deserialization, and wait-free synchronization.

interprocess-communication memory-mapping synchronization wait-free zero-copy

Last synced: 14 May 2025

https://github.com/udoprog/musli

Müsli is a flexible and efficient serialization framework

no-std rust serialization zero-copy

Last synced: 02 Apr 2026

https://github.com/xfbs/imstr

Immutable strings, in Rust.

cheap clone copy-on-write cow immutable rust slice string zero-copy

Last synced: 08 Apr 2026

https://github.com/voidDB/voidDB

A transactional key-value database written in Go for Linux and macOS

acid database fast go golang in-memory key-value lightweight linux macos mmap mvcc nosql replication storage zero-copy

Last synced: 15 Jul 2025

https://github.com/databento/dbn

Databento Binary Encoding (DBN) - Fast message encoding and storage format for market data

binary-encoding databento encoding low-latency market-data rust serialization storage tick-data zero-copy zstd

Last synced: 21 Apr 2026

https://github.com/J-Schoepplenberg/zero-packet

A zero-copy Rust library that builds and parses network packets in-place.

networking no-allocation packet-processing packets zero-copy

Last synced: 05 Apr 2025

https://github.com/frogsnot/concryptor

A gigabyte-per-second, multi-threaded file encryption engine. Achieves extreme throughput using a lock-free, triple-buffered io_uring pipeline, Rayon parallel chunking, and hardware-accelerated AEADs (AES-256-GCM / ChaCha20).

aead aes-gcm argon2 chacha20-poly1305 cli-tool cryptography encryption io-uring performance rust security zero-copy

Last synced: 09 Apr 2026

https://github.com/ajitpratap0/GoSQLX

High-performance SQL parser, formatter, linter & security scanner for Go — 1.5M+ ops/sec, multi-dialect, zero-copy, race-free

ast cli dialect go golang lsp mysql parser postgresql query-analyzer security sql sql-formatter sql-injection sql-linter sql-parser sql-validator sqlite wasm zero-copy

Last synced: 18 Mar 2026

https://github.com/ajitpratap0/gosqlx

High-performance SQL parser, formatter, linter & security scanner for Go — 1.5M+ ops/sec, multi-dialect, zero-copy, race-free

ast cli dialect go golang lsp mysql parser postgresql query-analyzer security sql sql-formatter sql-injection sql-linter sql-parser sql-validator sqlite wasm zero-copy

Last synced: 15 Mar 2026

https://github.com/avitex/rust-zc

Rust library providing `Zc` for self-referential zero-copy structures

no-std rust-lang zero-copy

Last synced: 24 Jul 2025

https://github.com/ygg01/linguini

C# Port of fluent.rs zero-copy parser

c-sharp dotnet i18n localization zero-copy

Last synced: 30 Jun 2025

https://github.com/nixman/flatjson

The extremely fast zero allocation and zero copying JSON parser

cplusplus flatjson json json-parser zero-copy

Last synced: 23 Mar 2025

https://github.com/charlesvdv/nom-bibtex

A feature complete bibtex parser using nom

bibtex latex nom parser rust zero-copy

Last synced: 09 Apr 2026

https://github.com/davidbuchanan314/unpng

A backward-compatible subset of the PNG file format, for uncompressed bitmaps

c png png-decoder png-encoder zero-copy

Last synced: 28 Aug 2025

https://github.com/forkni/cuda-link

Zero-copy bidirectional GPU texture sharing between TouchDesigner and Python via CUDA IPC. Sub-microsecond per-frame overhead with ring buffer architecture and GPU-side synchronization.

cuda cupy gpu inter-process-communication ipc python pytorch real-time shared-memory texture-sharing touchdesigner zero-copy

Last synced: 30 May 2026

https://github.com/althonos/iocursor

A zero-copy file-like wrapper for Python byte buffers, inspired by Rust's std::io::Cursor.

buffer file-like python python-c-extension python-extension sans-io zero-copy

Last synced: 07 Sep 2025

https://github.com/hslam/splice

Package splice wraps the splice system call.

go golang linux pipe socket splice zero-copy zerocopy

Last synced: 07 Sep 2025

https://github.com/mzabaluev/chunked-bytes

A non-contiguous byte output buffer for Rust

buffers input-output rust zero-copy

Last synced: 20 Jul 2025

https://github.com/infinilabs/zipora

Zipora – High-performance Rust compression with In-place compressed-access (no full decompression).

algorithms compression data-structures memory-safety performance rust simd succinct-data-structures zero-copy zipora

Last synced: 05 Apr 2026

https://github.com/quininer/tokio-linux-zio

[deprecated] Tokio Linux zero-copy IO

linux pipe sendfile splice tee zero-copy

Last synced: 19 Mar 2025

https://github.com/felixmcfelix/discortp

Lightweight, multipurpose rust library for handling RTP streams.

discord protocol-parser rtp rust zero-copy

Last synced: 02 Aug 2025

https://github.com/hazae41/fleche

Zero-copy HTTP protocol for the web 🏎️ (JS + WebAssembly)

browser deno fetch gzip http javascript protocol quic rpc typescript webassembly webstream webstreams zero-copy

Last synced: 19 Apr 2025

https://github.com/userfrm/thetadatadx

No-JVM ThetaData Terminal — native Rust SDK for direct MDDS (gRPC) and FPSS (TCP) market data access

async finance grpc historical-data low-latency market-data options python real-time rust streaming tcp thetadata tick-data zero-copy zstd

Last synced: 09 May 2026

https://github.com/hslam/sendfile

Package sendfile wraps the sendfile system call.

darwin go golang linux sendfile socket unix windows zero-copy zerocopy

Last synced: 28 Apr 2025

https://github.com/d-plaindoux/parsec.rust

Rust Parser Combinators

monad no-gc parser zero-copy

Last synced: 14 Jul 2025

https://github.com/artalis-io/keel

Minimal C11 HTTP client/server library built on raw epoll/kqueue/io_uring. Pluggable allocator, pluggable parser, pluggable TLS library, streaming responses, multipart uploads, 101K req/s on a single thread.

async c c11 epoll event-loop http http-server io-uring kqueue multipart sendfile threadpool tls zero-copy

Last synced: 06 Apr 2026

https://github.com/jemc/pony-rope

Pony implementation of a rope data structure for efficient, zero-copy manipulation of byte buffers.

library pony-language zero-copy

Last synced: 12 Feb 2026

https://github.com/maandree/shr

n-fold buffered shared memory segment for low-latency data streaming

c-library ipc zero-copy

Last synced: 24 Feb 2025

https://github.com/ksxgithub/zero-copy-pads

Padding/aligning values without heap allocation

alignment column crates no-std padding rust string zero-copy

Last synced: 12 May 2025

https://github.com/jzombie/rust-simd-r-drive

Zero-copy access, schema-less, append-only, SIMD-optimized binary storage engine for Rust.

append-only binary-storage key-value-store mmap simd-optimized storage-backend storage-container storage-engine zero-copy

Last synced: 10 Aug 2025

https://github.com/bitmeal/ueye-wrapper

iDS uEye camera C++ wrapper with dead simple (but limited) interface - high performance asynchronous concurrent image capture with zero-copy

camera camera-api computer-vision ids image-processing ueye zero-copy

Last synced: 29 Oct 2025

https://github.com/franz1981/franz_flow

Single Consumer implementations of a fixed & variable sized FastFlow-Lamport-Thompson ring-buffers

c c11 concurrent-data-structure high-performance ipc low-latency queue ring-buffer zero-copy

Last synced: 10 Jan 2026

https://github.com/carverauto/arancini

High-performance BMP collector.

bgp bgp-monitoring-protocol bmp io-uring zero-copy

Last synced: 06 Jun 2026

https://github.com/theremyyy/nyro-db

NyroDB is a next-generation database engine built from the ground up in Rust. It utilizes Zero-Copy Serialization, Asynchronous Batching, and Secondary Indexing to achieve performance that transcends modern understanding

dashmap database database-engine databases db engine performance realtime rust zero-copy

Last synced: 13 Jan 2026

https://github.com/TuxCoding/pwned-check

Check passwords against the offline haveibeenpwned database with focus on performance, but without any index or conversions

fadvise haveibeenpwned madvise mmap offline password pwned simd zero-copy

Last synced: 16 Apr 2025

https://github.com/tuxcoding/pwned-check

Check passwords against the offline haveibeenpwned database with focus on performance, but without any index or conversions

fadvise haveibeenpwned madvise mmap offline password pwned simd zero-copy

Last synced: 30 Aug 2025

https://github.com/zacharygolba/todotxt-rs

A zero-copy parser for the todo.txt format

parser todo-txt zero-copy

Last synced: 22 Mar 2025

https://github.com/franz1981/franz-flow-j

Single Consumer implementations of a fixed & variable sized FastFlow-Lamport-Thompson ring-buffers

concurrent-data-structure high-performance ipc java low-latency queue ring-buffer zero-copy

Last synced: 09 Jun 2026

https://github.com/xdagger/xdagj-p2p

🚀 High-performance Java P2P networking library for XDAG blockchain - Java 21 + Netty + Kademlia DHT + EIP-1459 DNS discovery

blockchain dht dns-discovery eip-1459 high-performance java java21 kademlia netty networking p2p protocol-buffers xdag zero-copy

Last synced: 25 Oct 2025

https://github.com/laphilosophia/strime

Streaming projection engine — extract fields at multi-gigabit speeds with O(1) memory

data-extraction data-processing fsm high-performance json json-parser json-streaming ndjson parser projection streaming typescript zero-copy

Last synced: 15 Feb 2026

https://github.com/sumant1122/ringlog

A highly optimized, thread-per-core message broker built from scratch in Rust, utilizing io_uring for zero-copy, low-latency commit log streaming.

commit-log high-performance io-uring low-latency message-broker rust systems-programming thread-per-core write-ahead-log zero-copy

Last synced: 21 Jun 2026

https://github.com/drbh/pybq

bq but python

biology dna zero-copy

Last synced: 04 Mar 2026

https://github.com/pjsny/macos-zero-copy-ipc

Fast zero-copy IPC for macOS using POSIX shared memory (not XPC) with examples

c interprocess-communication ipc macos memory-mapping mmap performance posix posix-shm shared-memory zero-copy

Last synced: 28 Feb 2025

https://github.com/copyleftdev/rustocache

🦀 The Ultimate High-Performance Caching Library for Rust - 100x faster than JavaScript alternatives with sub-microsecond latencies, memory safety, and chaos engineering

async benchmarking cache caching chaos-engineering high-performance lru memory-safety performance redis rust simd stampede-protection tokio zero-copy

Last synced: 20 Apr 2026

https://github.com/goceleris/celeris

Ultra-low latency Go HTTP engine. A protocol-aware dual-architecture (io_uring & epoll) designed for high-throughput infrastructure and zero-allocation microservices.

epoll go http-server io-uring linux performance zero-copy

Last synced: 24 May 2026

https://github.com/infinilabs/infini-zip

High-performance Rust implementation of advanced data structures and compression algorithms inspired by topling-zip C++ library

algorithms compression data-structures memory-safety performance rust simd succinct-data-structures topling-zip zero-copy

Last synced: 12 Aug 2025

https://github.com/dylan-sutton-chavez/edge-python-host

Official packages that embed host-side bridge code (e.g., JS) and expose it to Python through the capability protocol. Includes modules like requests for networking and DOM bindings for browser interaction.

api dom frontend host javascript memory-pointers package python rust wasm zero-copy

Last synced: 23 May 2026

https://github.com/jalalmostafa/mining-afxdp

Mining Linux Kernel Repositories to extract knowledge about AF_XDP

afxdp git linux linux-kernel packet-processing repository-mining statistics zero-copy

Last synced: 16 Feb 2026

https://github.com/paulohrpinheiro/mycp

Meus experimentos em copiar um arquivo na linguagem C em Linux

c linux mmap sendfile zero-copy

Last synced: 18 May 2026

https://github.com/bug-ops/pyhdb-rs

Rust-powered SAP HANA driver for Python with native Apache Arrow support. Zero-copy data transfer to Polars & Pandas. DB-API 2.0, async/await, connection pooling

arrow async database dbapi driver hana pandas performance polars pyo3 python rust sap sap-hana zero-copy

Last synced: 26 Apr 2026

https://github.com/kunobi-ninja/kache

Zero-copy, content-addressed Rust build cache. No copies, no wasted disk — just hardlinks locally and S3 for sharing.

build-cache caching ci developer-tools hardlinks rust s3 zero-copy

Last synced: 03 May 2026

https://github.com/yourarj/solana-anchor-zero-copy

demo for zero-copy accounts with anchor framework

anchor explainer sealevel solana zero-copy

Last synced: 29 Apr 2026

https://github.com/qu1x/in-situ

In Situ Endian-independent Bytes Access

bytes-access endian-independent in-situ parsing zero-copy

Last synced: 10 Jun 2026

https://github.com/intob/peregrine

A high-performance HTTP server, written from scratch in Zig. Built on kqueue/epoll.

iovec zero-alloc zero-copy

Last synced: 28 Oct 2025

https://github.com/shawnjeffersonwang/netty

This project focuses on Java NIO (Non-blocking I/O) and its three main components: Channels, Buffers, and Selectors. It includes examples of network programming, zero-copy techniques, I/O models, and the Netty framework.

bio java multithreading netty network-programming nio selector zero-copy

Last synced: 27 Jan 2026

https://github.com/debanjan06/latency-serve-edge

Native Rust edge inference engine with zero-copy memmap2 tensor loading, register-fused Linear+ReLU kernels, and scenario-aware MoE routing via rayon work-stealing — achieving 352µs lightweight and 1.39ms dense expert execution.

edge-computing high-performance inference-engine memory-mapping mixture-of-experts operator-fusion parallel-computing rust systems-programming zero-copy

Last synced: 11 Jun 2026

https://github.com/laugharne/rust_zero_copy

The concept of zero-copy in Rust refers to a technique of working with data in memory without making unnecessary copies, which significantly improves performance, particularly in high-throughput and low-latency environments. Since no data is copied, zero-copy, facilitated by references, leads to significant performance gains/

cow optimization pinocchio rust rust-lang solana zero-copy zerocopy

Last synced: 24 Apr 2026

https://github.com/laugharne/solana_optimized_programs

This video transcription explores techniques for optimizing Solana programs, focusing on the efficiency of computation, storage, and data. It includes practical tips, code examples, and performance comparisons between different frameworks such as Anchor and Pinocchio, as well as optimizations in assembly language.

anchor assembly optimization pinocchio rust sbpf solana zero-copy

Last synced: 10 May 2026

https://github.com/kumose/xconfig

Atomic configuration hot-reloading via PB Reflection & Double-Buffering.

configuration-management distributed-systems high-performance hot-reload kumo-infra lock-free protobu toml zero-copy

Last synced: 27 Apr 2026

https://github.com/cntm-labs/cntm-graph

High-performance custom graph engine for cognitive AI — zero-copy traversal with formal verification via Lean. The memory backbone for AGI.

agi flatbuffers formal-verification graph-database mmap mojo project-chronos rust shared-memory simd zero-copy

Last synced: 14 May 2026

https://github.com/priyabug/efficient-data-transfer-with-rdma-memory-registration-and-request-handling

This project explores efficient data transfer mechanisms using RDMA, focusing on memory registration, request handling, and performance optimizations.Here we can see the demonstration of how RDMA improves network efficiency by bypassing the operating system kernel and offloading data movement to the network interface card.

flow-control generating-memory operating-system pinning-memory read-direct-memory-access synchronization work-queue zero-copy

Last synced: 08 Aug 2025

https://github.com/thiagorigonatti/sleeker

A lightweight sub-millisecond p99 latency ultra high-performance non-blocking I/O io_uring and unix-domain-sockets compatible HTTP1/2/3 server module with easy TLS integration support.

asynchronous event-driven high-performance http-server http1 http2 io-uring java low-latency netty networking nio non-blocking reactive server ssl sub-millisecond tls unix-domain-sockets zero-copy

Last synced: 19 Apr 2026

https://github.com/phf/reconque

Replace queues that are in active use (mirror only, don't bother with PRs)

c dynamic queue reconfigure zero-copy

Last synced: 26 Jul 2025

https://github.com/typhoonzero/grpc_zerocopy_async_example

Example project of using grpc to do zerocopy large buffer communication.

grpc zero-copy

Last synced: 03 May 2026

https://github.com/momiji-rs/rostdown

A kramdown-compatible Markdown renderer in Rust: byte-identical HTML or a clean decline. Zero-dep, unsafe-free default build.

bridgetown gfm html jekyll kramdown markdown markdown-parser markdown-renderer markdown-to-html performance ruby rust simd zero-copy

Last synced: 26 Jun 2026

https://github.com/teragrep/net_01

Teragrep zero copy networking library for Java

java java-library java-network network-library teragrep zero-copy

Last synced: 24 Jan 2026

https://github.com/banyc/field_block

A definition language for buffer parsing. No code gen. Restrict business code to outside of the codec.

codec network parsing runtime zero-copy

Last synced: 25 Oct 2025

https://github.com/thaodt/tengbps-parser

A zero-copy binary data parser demonstrating file-backed SIMD processing

bytes rust simd zero-copy

Last synced: 11 Sep 2025

https://github.com/notquis/cpp-match

cpp-match is a powerful C++ library for pattern matching and functional-style programming, allowing developers to write concise and expressive code for handling complex data structures efficiently. The library provides a clean and intuitive syntax for matching patterns, making it easier to work with data in a functional programming paradigm.

cache-coherence computer-vision cpp kernel-bypass multiplatform object-tracker object-tracking opencv prefix-trie single-header-lib trading trie-structure tries zero-copy

Last synced: 15 Jul 2025

https://github.com/jamesgober/pack-io

Compact binary wire format with schema evolution and zero-copy deserialization for Rust.

binary codec reps rust schema-evolution serialization zero-copy

Last synced: 05 Jun 2026