{"id":128225,"url":"https://github.com/naranyala/awesome-serialization-deserialization","name":"awesome-serialization-deserialization","description":"A curated list of data serialization formats, libraries, tools, and resources across programming languages and use cases.","projects_count":214,"last_synced_at":"2026-08-14T20:00:24.565Z","repository":{"id":349279923,"uuid":"1201735064","full_name":"naranyala/awesome-serialization-deserialization","owner":"naranyala","description":"A curated list of data serialization formats, libraries, tools, and resources across programming languages and use cases.","archived":false,"fork":false,"pushed_at":"2026-04-05T04:59:45.000Z","size":15,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2026-07-26T11:04:19.912Z","etag":null,"topics":["deserialization","serialization"],"latest_commit_sha":null,"homepage":"","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/naranyala.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2026-04-05T04:45:04.000Z","updated_at":"2026-04-05T05:00:03.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/naranyala/awesome-serialization-deserialization","commit_stats":null,"previous_names":["naranyala/awesome-serialization-deserialization"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/naranyala/awesome-serialization-deserialization","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/naranyala%2Fawesome-serialization-deserialization","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/naranyala%2Fawesome-serialization-deserialization/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/naranyala%2Fawesome-serialization-deserialization/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/naranyala%2Fawesome-serialization-deserialization/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/naranyala","download_url":"https://codeload.github.com/naranyala/awesome-serialization-deserialization/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/naranyala%2Fawesome-serialization-deserialization/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":36663899,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-08-06T04:43:03.162Z","status":"online","status_checked_at":"2026-08-14T02:00:06.934Z","response_time":54,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"created_at":"2026-04-14T23:12:45.045Z","updated_at":"2026-08-14T20:00:24.565Z","primary_language":null,"list_of_lists":false,"displayable":true,"categories":["Related Awesome Lists","Libraries by Language","Serialization Formats","Use Cases \u0026 Applications","License","Standards \u0026 Specifications","Learning Resources","Tools \u0026 Utilities","Schema Evolution","Security Considerations"],"sub_categories":["Research Papers","Swift","Java \u0026 JVM","Zero-Copy \u0026 High-Performance Formats","Domain-Specific Formats","APIs \u0026 Network Services","Binary Formats","IETF RFC Standards","Workflow Management","C# \u0026 .NET","Security-Focused Serialization","Technical Documentation","Graph Data","Text-Based Formats","C \u0026 C++","Configuration Files","ISO Standards","Rust","Python","Machine Learning \u0026 AI","Evolution Rules by Format","W3C Standards","JavaScript \u0026 TypeScript","Go","Ruby","Scientific \u0026 Research","PHP","Documented CVEs","Mitigation Strategies"],"readme":"# Awesome Serialization \u0026 Deserialization [![Awesome](https://awesome.re/badge.svg)](https://awesome.re)\n\n\u003e A curated list of data serialization formats, libraries, tools, and resources across programming languages and use cases.\n\n**Serialization** is the process of converting data structures or objects into a format suitable for storage or transmission. **Deserialization** reconstructs the original data from the serialized format. These processes are foundational to data persistence, network communication, distributed systems, and cross-platform interoperability.\n\n## Contents\n\n- [Serialization Formats](#serialization-formats)\n  - [Text-Based Formats](#text-based-formats)\n  - [Binary Formats](#binary-formats)\n  - [Zero-Copy \u0026 High-Performance Formats](#zero-copy--high-performance-formats)\n  - [Domain-Specific Formats](#domain-specific-formats)\n- [Libraries by Language](#libraries-by-language)\n  - [Python](#python)\n  - [Java \u0026 JVM](#java--jvm)\n  - [JavaScript \u0026 TypeScript](#javascript--typescript)\n  - [C \u0026 C++](#c--c)\n  - [Rust](#rust)\n  - [Go](#go)\n  - [C# \u0026 .NET](#c--net)\n  - [Ruby](#ruby)\n  - [PHP](#php)\n  - [Swift](#swift)\n- [Use Cases \u0026 Applications](#use-cases--applications)\n  - [APIs \u0026 Network Services](#apis--network-services)\n  - [Big Data \u0026 Analytics](#big-data--analytics)\n  - [Machine Learning \u0026 AI](#machine-learning--ai)\n  - [Configuration Files](#configuration-files)\n  - [Security-Focused Serialization](#security-focused-serialization)\n  - [Scientific \u0026 Research](#scientific--research)\n  - [Graph Data](#graph-data)\n  - [Workflow Management](#workflow-management)\n  - [Schema Evolution](#schema-evolution)\n  - [Security Considerations](#security-considerations)\n  - [Known Vulnerabilities](#known-vulnerabilities)\n  - [Documented CVEs](#documented-cves)\n  - [Mitigation Strategies](#mitigation-strategies)\n- [Standards \u0026 Specifications](#standards--specifications)\n  - [IETF RFC Standards](#ietf-rfc-standards)\n  - [W3C Standards](#w3c-standards)\n  - [ISO Standards](#iso-standards)\n- [Tools \u0026 Utilities](#tools--utilities)\n- [Learning Resources](#learning-resources)\n  - [Technical Documentation](#technical-documentation)\n  - [Research Papers](#research-papers)\n- [Related Awesome Lists](#related-awesome-lists)\n\n---\n\n## Serialization Formats\n\n### Text-Based Formats\n\nHuman-readable formats suitable for debugging, configuration, and API communication.\n\n| Format | Full Name | Standard | Human-Readable | Schema Support | Binary Types | Links |\n|--------|-----------|----------|----------------|----------------|--------------|-------|\n| **[JSON](https://www.json.org/)** | JavaScript Object Notation | RFC 8259 | ✅ | ❌ (JSON Schema separate) | ❌ | [RFC 8259](https://datatracker.ietf.org/doc/html/rfc8259) |\n| **[XML](https://www.w3.org/XML/)** | Extensible Markup Language | W3C Recommendation | ✅ | ✅ (XSD) | ❌ (Base64) | [W3C XML](https://www.w3.org/XML/) |\n| **[YAML](https://yaml.org/)** | YAML Ain't Markup Language | YAML 1.2.2 Spec | ✅ | ❌ | ❌ | [Specification](https://yaml.org/spec/1.2.2/) |\n| **[TOML](https://toml.io/)** | Tom's Obvious Minimal Language | TOML 1.0.0 | ✅ | ❌ | ❌ | [Specification](https://toml.io/en/v1.0.0) |\n| **[CSV](https://en.wikipedia.org/wiki/Comma-separated_values)** | Comma-Separated Values | RFC 4180 | ✅ | ❌ | ❌ | [RFC 4180](https://datatracker.ietf.org/doc/html/rfc4180) |\n| **[JSON5](https://json5.org/)** | JSON for Humans | JSON5 Spec | ✅ | ❌ | ❌ | [Specification](https://json5.org/) |\n| **[JSONL/NDJSON](http://jsonlines.org/)** | JSON Lines | Convention | ✅ | ❌ | ❌ | [Specification](http://jsonlines.org/) |\n| **[ION](https://amzn.github.io/ion-docs/)** | Amazon Ion | Amazon Ion Spec | ✅ (text mode) | ❌ | ✅ (binary mode) | [GitHub](https://github.com/amazon-ion/ion-docs) |\n\n### Binary Formats\n\nCompact formats optimized for performance, storage efficiency, and network transmission.\n\n| Format | Developer/Org | Schema Required | Cross-Language | Schema Evolution | Links |\n|--------|---------------|-----------------|----------------|------------------|-------|\n| **[Protocol Buffers](https://developers.google.com/protocol-buffers)** | Google | ✅ (.proto) | ✅ (20+ languages) | ✅ (backward/forward) | [GitHub](https://github.com/protocolbuffers/protobuf) |\n| **[Apache Avro](https://avro.apache.org/)** | Apache Software Foundation | ✅ (JSON schema) | ✅ (Java, Python, C++, etc.) | ✅ (built-in) | [Website](https://avro.apache.org/) |\n| **[Apache Thrift](https://thrift.apache.org/)** | Apache (originally Facebook) | ✅ (.thrift) | ✅ (28+ languages) | ⚠️ (limited) | [Website](https://thrift.apache.org/) |\n| **[MessagePack](https://msgpack.org/)** | Sadayuki Furuhashi | ❌ | ✅ (70+ languages) | ❌ | [Website](https://msgpack.org/) |\n| **[CBOR](https://cbor.io/)** | IETF | ❌ | ✅ (50+ languages) | ❌ | [RFC 8949](https://datatracker.ietf.org/doc/html/rfc8949) |\n| **[BSON](https://bsonspec.org/)** | MongoDB | ❌ | ✅ (20+ languages) | ❌ | [Specification](https://bsonspec.org/) |\n| **[Smile](https://github.com/FasterXML/smile-format-specification)** | FasterXML | ❌ | ✅ (Java, others) | ❌ | [Spec](https://github.com/FasterXML/smile-format-specification) |\n| **[Hessian](http://hessian.caucho.com/)** | Caucho Technology | ❌ | ✅ (Java, Python, C#, etc.) | ❌ | [Website](http://hessian.caucho.com/) |\n\n### Zero-Copy \u0026 High-Performance Formats\n\nFormats enabling direct memory access without intermediate parsing/unpacking steps.\n\n| Format | Developer | Zero-Copy | Schema Required | Memory Mapping | Primary Use Case | Links |\n|--------|-----------|-----------|-----------------|----------------|------------------|-------|\n| **[Apache Arrow](https://arrow.apache.org/)** | Apache Software Foundation | ✅ | ❌ (implicit) | ✅ | In-memory analytics, DataFrame interchange | [GitHub](https://github.com/apache/arrow) |\n| **[FlatBuffers](https://flatbuffers.dev/)** | Google | ✅ | ✅ (.fbs) | ✅ | Gaming, mobile apps, low-latency systems | [GitHub](https://github.com/google/flatbuffers) |\n| **[Cap'n Proto](https://capnproto.org/)** | Kenton Varda (Sandstorm) | ✅ | ✅ (.capnp) | ✅ | High-performance RPC, distributed systems | [GitHub](https://github.com/capnproto/capnproto) |\n| **[Bebop](https://github.com/RainwayApp/bebop)** | Rainway | ✅ | ✅ (.bop) | ✅ | Game streaming, real-time applications | [GitHub](https://github.com/RainwayApp/bebop) |\n\n### Domain-Specific Formats\n\nFormats designed for specific industries, data types, or application domains.\n\n| Format | Domain | Type | Columnar | Schema | Description | Links |\n|--------|--------|------|----------|--------|-------------|-------|\n| **[Parquet](https://parquet.apache.org/)** | Big Data Analytics | Binary | ✅ | ✅ | Columnar storage for Hadoop ecosystem | [Website](https://parquet.apache.org/) |\n| **[ORC](https://orc.apache.org/)** | Big Data (Hive) | Binary | ✅ | ✅ | Optimized Row Columnar format | [Website](https://orc.apache.org/) |\n| **[HDF5](https://www.hdfgroup.org/solutions/hdf5/)** | Scientific Computing | Binary | ❌ | ✅ | Hierarchical Data Format for large datasets | [Website](https://www.hdfgroup.org/solutions/hdf5/) |\n| **[ONNX](https://onnx.ai/)** | Machine Learning | Binary (Protobuf) | ❌ | ✅ | Open Neural Network Exchange format | [Website](https://onnx.ai/) |\n| **[GGUF](https://github.com/ggerganov/ggml/blob/master/docs/gguf.md)** | LLM Inference | Binary | ❌ | ✅ | Quantized model format for llama.cpp | [GitHub](https://github.com/ggerganov/ggml) |\n| **[ASN.1](https://www.itu.int/en/ITU-T/asn1/)** | Telecommunications | Binary/Text | ❌ | ✅ | Abstract Syntax Notation One (ITU-T standard) | [ITU](https://www.itu.int/en/ITU-T/asn1/) |\n| **[NetCDF](https://www.unidata.ucar.edu/software/netcdf/)** | Earth/Climate Science | Binary | ✅ | ✅ | Network Common Data Form | [Website](https://www.unidata.ucar.edu/software/netcdf/) |\n| **[Delta Lake](https://delta.io/)** | Data Lakes | Binary (Parquet-based) | ✅ | ✅ | ACID transactions on data lakes | [Website](https://delta.io/) |\n| **[Apache Iceberg](https://iceberg.apache.org/)** | Data Lakes | Binary | ✅ | ✅ | Open table format for large datasets | [Website](https://iceberg.apache.org/) |\n| **[Lance](https://lancedb.github.io/lance/)** | ML/Data Science | Binary | ✅ | ✅ | Columnar format optimized for ML workloads | [GitHub](https://github.com/lancedb/lance) |\n| **[SavedModel](https://www.tensorflow.org/guide/saved_model)** | Deep Learning (TensorFlow) | Binary (Protobuf) | ❌ | ✅ | TensorFlow model serialization format | [Docs](https://www.tensorflow.org/guide/saved_model) |\n| **[CoreML](https://developer.apple.com/machine-learning/)** | Machine Learning (Apple) | Binary (Protobuf) | ❌ | ✅ | Apple's on-device ML model format | [Docs](https://developer.apple.com/documentation/coreml) |\n\n---\n\n## Libraries by Language\n\n### Python\n\n| Library | Formats | License | Description | Links |\n|---------|---------|---------|-------------|-------|\n| **[json](https://docs.python.org/3/library/json.html)** | JSON | PSF | Built-in JSON encoder/decoder (stdlib) | [Docs](https://docs.python.org/3/library/json.html) |\n| **[pickle](https://docs.python.org/3/library/pickle.html)** | Python-specific | PSF | Python object serialization (stdlib) ⚠️ | [Docs](https://docs.python.org/3/library/pickle.html) |\n| **[msgpack-python](https://pypi.org/project/msgpack/)** | MessagePack | Apache 2.0 | MessagePack implementation | [PyPI](https://pypi.org/project/msgpack/) |\n| **[srsly](https://github.com/explosion/srsly)** | JSON, MsgPack, YAML | MIT | High-performance serialization wrapper | [GitHub](https://github.com/explosion/srsly) |\n| **[avro-python3](https://pypi.org/project/avro-python3/)** | Avro | Apache 2.0 | Apache Avro implementation | [PyPI](https://pypi.org/project/avro-python3/) |\n| **[protobuf](https://pypi.org/project/protobuf/)** | Protocol Buffers | BSD-3 | Official Google protobuf | [PyPI](https://pypi.org/project/protobuf/) |\n| **[pyarrow](https://arrow.apache.org/docs/python/)** | Arrow, Parquet, Feather | Apache 2.0 | Apache Arrow Python bindings | [Docs](https://arrow.apache.org/docs/python/) |\n| **[pyyaml](https://github.com/yaml/pyyaml)** | YAML | MIT | YAML parser and emitter | [GitHub](https://github.com/yaml/pyyaml) |\n| **[orjson](https://github.com/ijl/orjson)** | JSON | Apache 2.0/MIT | Fast, correct Python JSON (Rust-based) | [GitHub](https://github.com/ijl/orjson) |\n| **[ujson](https://github.com/ultrajson/ultrajson)** | JSON | BSD-3 | Ultra-fast JSON encoder/decoder (C-based) | [GitHub](https://github.com/ultrajson/ultrajson) |\n| **[safetensors](https://github.com/huggingface/safetensors)** | Custom | Apache 2.0 | Secure ML tensor format | [GitHub](https://github.com/huggingface/safetensors) |\n\n### Java \u0026 JVM\n\n| Library | Formats | License | Description | Links |\n|---------|---------|---------|-------------|-------|\n| **[Jackson](https://github.com/FasterXML/jackson)** | JSON, Smile, CBOR, YAML, XML | Apache 2.0 | Most widely-used Java serialization | [GitHub](https://github.com/FasterXML/jackson) |\n| **[Gson](https://github.com/google/gson)** | JSON | Apache 2.0 | Google's JSON library for Java | [GitHub](https://github.com/google/gson) |\n| **[Moshi](https://github.com/square/moshi)** | JSON | Apache 2.0 | Modern JSON library by Square | [GitHub](https://github.com/square/moshi) |\n| **[dsl-json](https://github.com/ngs-doo/dsl-json)** | JSON | BSD-3 | High-performance Java JSON library | [GitHub](https://github.com/ngs-doo/dsl-json) |\n| **[Kryo](https://github.com/EsotericSoftware/kryo)** | Binary | BSD-3 | Fast, efficient Java serialization | [GitHub](https://github.com/EsotericSoftware/kryo) |\n| **[protobuf-java](https://github.com/protocolbuffers/protobuf)** | Protocol Buffers | BSD-3 | Official Java protobuf | [GitHub](https://github.com/protocolbuffers/protobuf) |\n| **[Avro Java](https://avro.apache.org/docs/current/gettingstartedjava.html)** | Avro | Apache 2.0 | Apache Avro for Java | [Docs](https://avro.apache.org/docs/current/gettingstartedjava.html) |\n\n### JavaScript \u0026 TypeScript\n\n| Library | Formats | License | Description | Links |\n|---------|---------|---------|-------------|-------|\n| **[JSON (native)](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/JSON)** | JSON | ECMAScript Spec | Built-in JSON support (ES5+) | [MDN](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/JSON) |\n| **[BSON.js](https://github.com/mongodb/js-bson)** | BSON | Apache 2.0 | BSON implementation in JavaScript | [GitHub](https://github.com/mongodb/js-bson) |\n| **[msgpack-javascript](https://github.com/msgpack/msgpack-javascript)** | MessagePack | Apache 2.0 | MessagePack for JavaScript | [GitHub](https://github.com/msgpack/msgpack-javascript) |\n| **[avsc](https://github.com/mtth/avsc)** | Avro | BSD-3 | Zero-dependency Avro implementation | [GitHub](https://github.com/mtth/avsc) |\n| **[protobuf.js](https://github.com/protobufjs/protobuf.js)** | Protocol Buffers | BSD-3 | Protocol Buffers for JavaScript | [GitHub](https://github.com/protobufjs/protobuf.js) |\n| **[schemapack](https://github.com/phretaddin/schemapack)** | Custom binary | MIT | Schema-based binary encoding | [GitHub](https://github.com/phretaddin/schemapack) |\n| **[cbor-js](https://github.com/paroga/cbor-js)** | CBOR | MIT | CBOR implementation | [GitHub](https://github.com/paroga/cbor-js) |\n| **[msgpackr](https://github.com/kriszyp/msgpackr)** | MessagePack | MIT | High-performance MessagePack | [GitHub](https://github.com/kriszyp/msgpackr) |\n\n### C \u0026 C++\n\n| Library | Formats | License | Description | Links |\n|---------|---------|---------|-------------|-------|\n| **[RapidJSON](https://github.com/Tencent/rapidjson)** | JSON | MIT | Fast C++ JSON parser/generator | [GitHub](https://github.com/Tencent/rapidjson) |\n| **[nlohmann/json](https://github.com/nlohmann/json)** | JSON | MIT | JSON for Modern C++ | [GitHub](https://github.com/nlohmann/json) |\n| **[simdjson](https://github.com/simdjson/simdjson)** | JSON | Apache 2.0 | Gigabytes/sec JSON parsing (SIMD) | [GitHub](https://github.com/simdjson/simdjson) |\n| **[ArduinoJson](https://arduinojson.org/)** | JSON | MIT | JSON library for embedded C++ | [Website](https://arduinojson.org/) |\n| **[BitSerializer](https://github.com/PavelYevstifeev/bitserializer)** | JSON, XML, YAML, CSV, MsgPack | MIT | Multi-format C++ serialization | [GitHub](https://github.com/PavelYevstifeev/bitserializer) |\n| **[Bitsery](https://github.com/fraillt/bitsery)** | Binary | MIT | Header-only binary serialization | [GitHub](https://github.com/fraillt/bitsery) |\n| **[Jansson](https://github.com/akheron/jansson)** | JSON | MIT | C library for JSON | [GitHub](https://github.com/akheron/jansson) |\n| **[jsmn](https://github.com/zserge/jsmn)** | JSON | MIT | Minimalistic JSON parser for C | [GitHub](https://github.com/zserge/jsmn) |\n| **[protobuf-c](https://github.com/protobuf-c/protobuf-c)** | Protocol Buffers | BSD-2 | Protobuf implementation for C | [GitHub](https://github.com/protobuf-c/protobuf-c) |\n| **[flatbuffers](https://github.com/google/flatbuffers)** | FlatBuffers | Apache 2.0 | Official FlatBuffers C++ | [GitHub](https://github.com/google/flatbuffers) |\n\n### Rust\n\n| Library | Formats | License | Description | Links |\n|---------|---------|---------|-------------|-------|\n| **[Serde](https://serde.rs/)** | Multiple (via adapters) | Apache 2.0/MIT | Serialization framework for Rust | [Website](https://serde.rs/) |\n| **[serde_json](https://github.com/serde-rs/json)** | JSON | Apache 2.0/MIT | Serde JSON adapter | [GitHub](https://github.com/serde-rs/json) |\n| **[bincode](https://github.com/bincode-org/bincode)** | Binary | MIT | Binary encoder for Rust | [GitHub](https://github.com/bincode-org/bincode) |\n| **[rmp-serde](https://github.com/3Hren/msgpack-rust)** | MessagePack | MIT | MessagePack for Rust | [GitHub](https://github.com/3Hren/msgpack-rust) |\n| **[quick-xml](https://github.com/tafia-eu/quick-xml)** | XML | MIT | High-performance XML parser | [GitHub](https://github.com/tafia-eu/quick-xml) |\n| **[toml-rs](https://github.com/toml-rs/toml)** | TOML | Apache 2.0/MIT | TOML encoder/decoder | [GitHub](https://github.com/toml-rs/toml) |\n| **[postcard](https://github.com/jamesmunns/postcard)** | Binary | Apache 2.0/MIT | Compact binary for embedded | [GitHub](https://github.com/jamesmunns/postcard) |\n| **[capnp](https://capnproto.org/)** | Cap'n Proto | MIT | Official Cap'n Proto for Rust | [Website](https://capnproto.org/) |\n\n### Go\n\n| Library | Formats | License | Description | Links |\n|---------|---------|---------|-------------|-------|\n| **[encoding/json](https://pkg.go.dev/encoding/json)** | JSON | BSD-3 | Built-in JSON package (stdlib) | [Docs](https://pkg.go.dev/encoding/json) |\n| **[gob](https://pkg.go.dev/encoding/gob)** | GOB | BSD-3 | Go's native binary format (stdlib) | [Docs](https://pkg.go.dev/encoding/gob) |\n| **[protobuf-go](https://github.com/protocolbuffers/protobuf-go)** | Protocol Buffers | BSD-3 | Official Go protobuf | [GitHub](https://github.com/protocolbuffers/protobuf-go) |\n| **[vmihailenco/msgpack](https://github.com/vmihailenco/msgpack)** | MessagePack | MIT | MessagePack for Go | [GitHub](https://github.com/vmihailenco/msgpack) |\n| **[go-yaml/yaml](https://github.com/go-yaml/yaml)** | YAML | Apache 2.0/MIT | YAML support for Go | [GitHub](https://github.com/go-yaml/yaml) |\n| **[segmentio/encoding](https://github.com/segmentio/encoding)** | JSON, Avro | MIT | High-performance encoding | [GitHub](https://github.com/segmentio/encoding) |\n| **[json-iterator/go](https://github.com/json-iterator/go)** | JSON | MIT | Drop-in JSON replacement | [GitHub](https://github.com/json-iterator/go) |\n\n### C# \u0026 .NET\n\n| Library | Formats | License | Description | Links |\n|---------|---------|---------|-------------|-------|\n| **[System.Text.Json](https://docs.microsoft.com/en-us/dotnet/api/system.text.json)** | JSON | MIT | Built-in .NET JSON (.NET Core 3.0+) | [Docs](https://docs.microsoft.com/en-us/dotnet/api/system.text.json) |\n| **[Newtonsoft.Json](https://www.newtonsoft.com/json)** | JSON | MIT | Most popular .NET JSON library | [Website](https://www.newtonsoft.com/json) |\n| **[protobuf-net](https://github.com/protobuf-net/protobuf-net)** | Protocol Buffers | Apache 2.0 | Protobuf for .NET | [GitHub](https://github.com/protobuf-net/protobuf-net) |\n| **[MessagePack-CSharp](https://github.com/MessagePack-CSharp/MessagePack-CSharp)** | MessagePack | MIT | Fast MessagePack for C# | [GitHub](https://github.com/MessagePack-CSharp/MessagePack-CSharp) |\n| **[ZeroFormatter](https://github.com/neuecc/ZeroFormatter)** | Binary | MIT | Fastest deserialization for .NET | [GitHub](https://github.com/neuecc/ZeroFormatter) |\n\n### Ruby\n\n| Library | Formats | License | Description | Links |\n|---------|---------|---------|-------------|-------|\n| **[json](https://ruby-doc.org/stdlib/libdoc/json/rdoc/JSON.html)** | JSON | Ruby | Built-in JSON (stdlib) | [Docs](https://ruby-doc.org/stdlib/libdoc/json/rdoc/JSON.html) |\n| **[oj](https://github.com/ohler55/oj)** | JSON | MIT | Optimized JSON parser (C extension) | [GitHub](https://github.com/ohler55/oj) |\n| **[MultiJSON](https://github.com/intridea/multi_json)** | JSON | MIT | Common interface for JSON libs | [GitHub](https://github.com/intridea/multi_json) |\n| **[msgpack-ruby](https://github.com/msgpack/msgpack-ruby)** | MessagePack | Apache 2.0 | MessagePack for Ruby | [GitHub](https://github.com/msgpack/msgpack-ruby) |\n\n### PHP\n\n| Library | Formats | License | Description | Links |\n|---------|---------|---------|-------------|-------|\n| **[json_encode/decode](https://www.php.net/manual/en/book.json.php)** | JSON | PHP | Built-in PHP JSON (stdlib) | [Docs](https://www.php.net/manual/en/book.json.php) |\n| **[webmozart/json](https://github.com/webmozarts/json)** | JSON | MIT | JSON validation library | [GitHub](https://github.com/webmozarts/json) |\n\n### Swift\n\n| Library | Formats | License | Description | Links |\n|---------|---------|---------|-------------|-------|\n| **[Codable](https://developer.apple.com/documentation/swift/codable)** | JSON, Plist | Apple | Built-in Swift serialization (Swift 4+) | [Docs](https://developer.apple.com/documentation/swift/codable) |\n| **[SwiftyJSON](https://github.com/SwiftyJSON/SwiftyJSON)** | JSON | MIT | Easier JSON handling | [GitHub](https://github.com/SwiftyJSON/SwiftyJSON) |\n| **[MessagePack.swift](https://github.com/chriseidhof/MessagePack.swift)** | MessagePack | MIT | MessagePack for Swift | [GitHub](https://github.com/chriseidhof/MessagePack.swift) |\n\n---\n\n## Use Cases \u0026 Applications\n\n### APIs \u0026 Network Services\n\n| Technology | Format(s) | Type | Schema | Production Users | Links |\n|------------|-----------|------|--------|------------------|-------|\n| **[gRPC](https://grpc.io/)** | Protocol Buffers | RPC framework | ✅ | Netflix, Cisco, Uber, Twitter | [Website](https://grpc.io/) |\n| **[RSocket](https://rsocket.io/)** | Various | Reactive protocol | ✅ | Netflix, Facebook | [Website](https://rsocket.io/) |\n| **[Connect](https://connect.build/)** | Protobuf, JSON | RPC framework | ✅ | buf.build clients | [Website](https://connect.build/) |\n| **[CloudEvents](https://cloudevents.io/)** | JSON, Protobuf, Avro | Event specification | ✅ | CNCF projects | [Website](https://cloudevents.io/) |\n| **[AsyncAPI](https://www.asyncapi.com/)** | JSON, YAML | Event-driven API spec | ⚠️ | Event-driven architectures | [Website](https://www.asyncapi.com/) |\n\n### Big Data \u0026 Analytics\n\n| Technology | Format(s) | Storage Type | Compression | Ecosystem | Links |\n|------------|-----------|--------------|-------------|-----------|-------|\n| **[Apache Parquet](https://parquet.apache.org/)** | Parquet | Columnar | Snappy, Gzip, LZO | Hadoop, Spark, Presto | [Website](https://parquet.apache.org/) |\n| **[Apache ORC](https://orc.apache.org/)** | ORC | Columnar | ZLIB, Snappy | Hive, Spark SQL | [Website](https://orc.apache.org/) |\n| **[Apache Arrow](https://arrow.apache.org/)** | Arrow, Feather | In-memory columnar | N/A | Pandas, Polars, DuckDB | [Website](https://arrow.apache.org/) |\n| **[Apache Avro](https://avro.apache.org/)** | Avro | Row-based | Deflate | Kafka, Hadoop | [Website](https://avro.apache.org/) |\n| **[Delta Lake](https://delta.io/)** | Parquet-based | Columnar + transaction log | Snappy, ZSTD | Databricks, Spark | [Website](https://delta.io/) |\n| **[Apache Iceberg](https://iceberg.apache.org/)** | Parquet/ORC/Arrow | Columnar + metadata | Various | Spark, Flink, Trino | [Website](https://iceberg.apache.org/) |\n\n### Machine Learning \u0026 AI\n\n| Technology | Format | Base Format | Framework Support | Zero-Copy | Links |\n|------------|--------|-------------|-------------------|-----------|-------|\n| **[ONNX](https://onnx.ai/)** | ONNX | Protobuf | PyTorch, TensorFlow, scikit-learn | ❌ | [Website](https://onnx.ai/) |\n| **[TensorFlow SavedModel](https://www.tensorflow.org/guide/saved_model)** | SavedModel | Protobuf | TensorFlow | ❌ | [Docs](https://www.tensorflow.org/guide/saved_model) |\n| **[CoreML](https://developer.apple.com/machine-learning/)** | CoreML | Protobuf | Core ML Tools | ❌ | [Docs](https://developer.apple.com/machine-learning/) |\n| **[GGUF](https://github.com/ggerganov/ggml/blob/master/docs/gguf.md)** | GGUF | Custom | llama.cpp, Ollama | ✅ (mmap) | [GitHub](https://github.com/ggerganov/ggml) |\n| **[safetensors](https://github.com/huggingface/safetensors)** | Safetensors | Custom | PyTorch, TensorFlow, JAX | ✅ (mmap) | [GitHub](https://github.com/huggingface/safetensors) |\n| **[MLIR](https://mlir.llvm.org/)** | MLIR | Text/Binary | LLVM, XLA, IREE | ❌ | [Website](https://mlir.llvm.org/) |\n| **[Lance](https://lancedb.github.io/lance/)** | Lance | Custom | LanceDB, Pandas | ✅ | [GitHub](https://github.com/lancedb/lance) |\n\n**Agentic AI \u0026 LLM Protocols:**\n\n| Protocol/Format | Type | Serialization | Status | Links |\n|-----------------|------|---------------|--------|-------|\n| **[MCP](https://modelcontextprotocol.io/)** | AI context protocol | JSON-RPC | v1.0 (2024) | [Website](https://modelcontextprotocol.io/) |\n| **[A2A](https://google.github.io/A2A/)** | Agent interoperability | JSON | Draft | [GitHub](https://github.com/google/A2A) |\n| **[BAML](https://www.boundaryml.com/baml)** | Structured LLM output | Custom DSL | Active development | [Website](https://www.boundaryml.com/baml) |\n\n### Configuration Files\n\n| Format | Indentation | Comments | Multi-line Strings | Data Types | Common Usage | Links |\n|--------|-------------|----------|-------------------|------------|--------------|-------|\n| **[YAML](https://yaml.org/)** | Significant whitespace | ✅ | ✅ | Rich (maps, sequences, scalars) | Kubernetes, Docker Compose, GitHub Actions | [Specification](https://yaml.org/spec/1.2.2/) |\n| **[TOML](https://toml.io/)** | Section-based | ✅ | ✅ | Basic types, arrays, dates | Cargo, Poetry, Hugo | [Specification](https://toml.io/) |\n| **[JSON](https://www.json.org/)** | Flexible | ❌ | ❌ | Objects, arrays, strings, numbers, booleans, null | VS Code, TypeScript, npm | [RFC 8259](https://datatracker.ietf.org/doc/html/rfc8259) |\n| **[JSON5](https://json5.org/)** | Flexible | ✅ | ✅ | Extended JSON | Development configs | [Specification](https://json5.org/) |\n| **[CUE](https://cuelang.org/)** | Flexible | ✅ | ✅ | Types + values | Infrastructure as Code | [Website](https://cuelang.org/) |\n| **[Pkl](https://pkl-lang.org/)** | Flexible | ✅ | ✅ | Rich (classes, functions) | Apple ecosystem | [Website](https://pkl-lang.org/) |\n| **[KCL](https://kcl-lang.io/)** | Flexible | ✅ | ✅ | Constraint-based | Cloud-native config | [Website](https://kcl-lang.io/) |\n| **[HCL](https://github.com/hashicorp/hcl)** | Block-based | ✅ | ✅ | Blocks, attributes, lists | Terraform, Vault | [GitHub](https://github.com/hashicorp/hcl) |\n\n### Security-Focused Serialization\n\n| Technology | Format | Security Property | Description | Links |\n|------------|--------|-------------------|-------------|-------|\n| **[safetensors](https://github.com/huggingface/safetensors)** | Binary | No arbitrary code execution | Header-based format with only tensor data; prevents pickle RCE | [GitHub](https://github.com/huggingface/safetensors) |\n| **[COSE](https://datatracker.ietf.org/doc/html/rfc8152)** | CBOR-based | Cryptographic signatures | CBOR Object Signing and Encryption | [RFC 8152](https://datatracker.ietf.org/doc/html/rfc8152) |\n| **[PASETO](https://paseto.io/)** | JSON/Binary | Tamper-proof tokens | Platform-Agnostic SEcure TOkens (JWT alternative) | [Website](https://paseto.io/) |\n| **[SealedObject](https://docs.oracle.com/javase/8/docs/api/java/security/SealedObject.html)** | Java Serialized | Encryption | Encrypted Java objects using cryptographic seals | [Java Docs](https://docs.oracle.com/javase/8/docs/api/java/security/SealedObject.html) |\n| **[Capsule (Java)](https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/io/ObjectInputFilter.html)** | Java Serialized | Object filtering | ObjectInputFilter for controlling deserialization | [Java Docs](https://docs.oracle.com/en/java/javase/17/docs/api/java.base/java/io/ObjectInputFilter.html) |\n\n### Scientific \u0026 Research\n\n| Format | Primary Domain | Data Model | Max Dimensions | Chunking | Parallel I/O | Links |\n|--------|---------------|------------|----------------|----------|--------------|-------|\n| **[HDF5](https://www.hdfgroup.org/solutions/hdf5/)** | General scientific | Hierarchical groups/datasets | Unlimited | ✅ | ✅ | [Website](https://www.hdfgroup.org/solutions/hdf5/) |\n| **[NetCDF](https://www.unidata.ucar.edu/software/netcdf/)** | Climate/Earth science | Self-describing arrays | 7 (conventional) | ✅ | ✅ | [Website](https://www.unidata.ucar.edu/software/netcdf/) |\n| **[Zarr](https://zarr.dev/)** | Earth science, biology | Chunked N-D arrays | Unlimited | ✅ | ✅ | [Website](https://zarr.dev/) |\n| **[ASDF](https://asdf-standard.readthedocs.io/)** | Astronomy | Tree + binary blocks | Unlimited | ✅ | ❌ | [Docs](https://asdf-standard.readthedocs.io/) |\n| **[npy/npz](https://numpy.org/doc/stable/reference/generated/numpy.lib.format.html)** | Python/NumPy | Single/multi arrays | Unlimited | ❌ | ❌ | [NumPy Docs](https://numpy.org/doc/stable/reference/generated/numpy.lib.format.html) |\n\n### Graph Data\n\n| Format | Type | Schema | RDF Compatible | Tools | Links |\n|--------|------|--------|----------------|-------|-------|\n| **[JSON-LD](https://json-ld.org/)** | Text (JSON-based) | JSON-LD Context | ✅ | JSON-LD Playground | [Website](https://json-ld.org/) |\n| **[Turtle](https://www.w3.org/TR/turtle/)** | Text | RDFS/OWL | ✅ | Apache Jena | [W3C Spec](https://www.w3.org/TR/turtle/) |\n| **[GraphML](http://graphml.graphdrawing.org/)** | XML-based | GraphML Schema | ❌ | yEd, Gephi | [Website](http://graphml.graphdrawing.org/) |\n| **[DOT](https://graphviz.org/doc/info/lang.html)** | Text | ❌ | ❌ | Graphviz | [Graphviz](https://graphviz.org/) |\n| **[GraphSON](https://tinkerpop.apache.org/docs/current/dev/io/#graphson)** | Text (JSON-based) | ❌ | ❌ | Apache TinkerPop | [Docs](https://tinkerpop.apache.org/docs/current/dev/io/#graphson) |\n| **[GML](https://en.wikipedia.org/wiki/Graph_Modelling_Language)** | Text | ❌ | ❌ | NetworkX, igraph | [Wikipedia](https://en.wikipedia.org/wiki/Graph_Modelling_Language) |\n\n### Workflow Management\n\n| Technology | Format | Execution Engine | Domain | Links |\n|------------|--------|-----------------|--------|-------|\n| **[CWL](https://www.commonwl.org/)** | YAML | cwltool, Toil | Bioinformatics, data analysis | [Website](https://www.commonwl.org/) |\n| **[Apache Airflow](https://airflow.apache.org/)** | Python (DAG definitions) | Airflow scheduler | General workflow orchestration | [Website](https://airflow.apache.org/) |\n| **[WDL](https://openwdl.org/)** | Custom DSL | Cromwell, MiniWDL | Bioinformatics | [Website](https://openwdl.org/) |\n| **[Nextflow](https://www.nextflow.io/)** | Custom DSL (Groovy-based) | Nextflow runtime | Computational pipelines | [Website](https://www.nextflow.io/) |\n\n---\n\n## Schema Evolution\n\n### Compatibility Modes\n\n| Mode | Definition | Upgrade Order | Guarantee | Use Case |\n|------|------------|---------------|-----------|----------|\n| **Backward** | New schema reads old data | Consumers upgrade first | ✅ Upgraded consumers process historical messages | Consumer-led upgrades |\n| **Forward** | Old schema reads new data | Producers upgrade first | ✅ Legacy consumers process new messages (ignore unknown fields) | Producer-led upgrades |\n| **Full** | Both backward and forward compatible | Either order | ✅ Bidirectional compatibility | Highest safety requirement |\n| **None** | No compatibility checking | N/A | ❌ No guarantees | Development/testing only |\n\n### Evolution Rules by Format\n\n| Change | Protobuf | Avro | Thrift | Notes |\n|--------|----------|------|--------|-------|\n| Add optional field (with default) | ✅ Safe | ✅ Safe | ✅ Safe | Requires default value |\n| Remove field | ✅ Safe (field number reserved) | ✅ Safe (reader ignores) | ⚠️ Risk | Must not reuse field numbers/names |\n| Rename field | ⚠️ Risk (by name in JSON) | ❌ Breaks | ❌ Breaks | Use aliases if supported |\n| Change field type | ❌ Breaks | ❌ Breaks | ❌ Breaks | Generally incompatible |\n| Add required field | ❌ Breaks backward | ❌ Breaks (no default) | ❌ Breaks | Always provide default |\n| Change field number (Protobuf) | ❌ Breaks | N/A | N/A | Never change field numbers |\n| Change field ID (Thrift) | N/A | N/A | ❌ Breaks | Never change numeric IDs |\n\n**Schema Registry Support:**\n\n| Registry | Formats | Compatibility Modes | Vendor | Links |\n|----------|---------|---------------------|--------|-------|\n| **Confluent Schema Registry** | Avro, Protobuf, JSON Schema | Backward, Forward, Full, None | Confluent | [Docs](https://docs.confluent.io/platform/current/schema-registry/index.html) |\n| **Apicurio Registry** | Avro, Protobuf, JSON Schema, XML | Multiple | Red Hat | [Website](https://www.apicur.io/) |\n| **AWS Glue Schema Registry** | Avro, JSON Schema, Protobuf | Backward, Full | AWS | [Docs](https://docs.aws.amazon.com/glue/latest/dg/schema-registry.html) |\n\n**Best Practices:**\n- ✅ Always assign **default values** to new fields\n- ✅ **Never reuse** field numbers/names after removal\n- ✅ **Never change** field identifiers (numbers, IDs)\n- ✅ Test compatibility with **both old and new** schemas\n- ✅ Use Schema Registry to **enforce compatibility** at registration time\n- ❌ Avoid removing fields without **deprecation period**\n\n---\n\n## Security Considerations\n\n### Known Vulnerabilities\n\n| Vulnerability Type | Mechanism | Impact | Affected Formats | Severity |\n|-------------------|-----------|--------|------------------|----------|\n| **Insecure Deserialization** | Malicious serialized objects execute code during deserialization | Remote Code Execution (RCE) | Java Serialization, Python pickle, PHP Serialization, .NET BinaryFormatter | **Critical** (OWASP Top 10) |\n| **XML External Entity (XXE)** | XML parser processes external entity references | File disclosure, SSRF, DoS | XML | **High** |\n| **YAML Deserialization** | YAML parsers execute arbitrary objects/functions | RCE | YAML (PyYAML, SnakeYAML) | **Critical** |\n| **Object Injection** | User-controlled data deserialized into objects | Auth bypass, privilege escalation | PHP, Python pickle, Ruby Marshal | **High** |\n| **Billion Laughs Attack** | Exponential entity expansion in XML | DoS (memory exhaustion) | XML | **High** |\n| **Zip Bomb (via serialization)** | Compressed data expands exponentially | DoS (disk/CPU exhaustion) | Any compressed serialization | **Medium** |\n| **Pickle RCE** | `__reduce__` method executes arbitrary code | RCE | Python pickle | **Critical** |\n\n### Documented CVEs\n\n| CVE | Year | Affected System | Format | Impact | CVSS | Links |\n|-----|------|-----------------|--------|--------|------|-------|\n| **CVE-2024-41874** | 2024 | Adobe ColdFusion | Untrusted data deserialization | RCE | N/A | [NVD](https://nvd.nist.gov/vuln/detail/cve-2024-41874) |\n| **CVE-2024-11039** | 2024 | Python pickle-based systems | Pickle | Remote command execution | N/A | [CVE Details](https://www.cvedetails.com/cve/CVE-2024-11039/) |\n| **CVE-2023-34040** | 2023 | Spring Framework (Java) | Java deserialization | RCE via exception record headers | N/A | [Spring](https://spring.io/security/cve-2023-34040/) |\n| **CVE-2024-0692** | 2024 | H2 Database (Java) | Java deserialization | RCE | N/A | [OWASP](https://owasp.org/www-chapter-stuttgart/assets/slides/2024-12-10_Exploiting_deserialization_vulnerabilities_in_recent_Java_versions.pdf) |\n| **CVE-2022-25857** | 2022 | Python packages | YAML (PyYAML) | RCE via yaml.load() | 8.0 | [NVD](https://nvd.nist.gov/vuln/detail/CVE-2022-25857) |\n| **CVE-2017-12626** | 2017 | Apache Solr | YAML (SnakeYAML) | RCE | 9.8 | [NVD](https://nvd.nist.gov/vuln/detail/CVE-2017-12626) |\n\n### Mitigation Strategies\n\n| Strategy | Implementation | Effectiveness | Applicability |\n|----------|----------------|---------------|---------------|\n| **Never deserialize untrusted data** | Reject unknown sources | ✅ Complete | All formats |\n| **Use schema-based formats** | Protobuf, Avro, FlatBuffers | ✅ High (type safety) | Cross-language systems |\n| **Replace pickle with safe alternatives** | Use json, safetensors | ✅ High | Python, ML models |\n| **Use yaml.safe_load() instead of yaml.load()** | PyYAML safe loader | ✅ High | Python YAML parsing |\n| **Implement ObjectInputFilter (Java)** | Class allowlists | ✅ High | Java deserialization |\n| **Disable external entities (XML)** | Parser configuration | ✅ High | XML parsing |\n| **Validate input before deserialization** | Schema validation, checksums | ✅ High | All formats |\n| **Use integrity checks** | HMAC signatures, checksums | ✅ High | Network transmission |\n| **Limit payload size** | Maximum size enforcement | ✅ Medium | DoS prevention |\n| **Keep libraries updated** | Patch management | ✅ Medium | All formats |\n| **Use cryptographic seals** | SealedObject (Java) | ✅ High | Sensitive data |\n| **Implement deserialization timeouts** | Time-limited parsing | ✅ Medium | DoS prevention |\n\n**Security Resources:**\n- [OWASP Deserialization Cheat Sheet](https://cheatsheetseries.owasp.org/cheatsheets/Deserialization_Cheat_Sheet.html)\n- [PortSwigger Deserialization Attacks](https://portswigger.net/web-security/deserialization)\n- [Android Unsafe Deserialization](https://developer.android.com/privacy-and-security/risks/unsafe-deserialization)\n- [Secure Deserialization of Pickle-based ML Models (ACM)](https://dl.acm.org/doi/10.1145/3719027.3765037)\n\n---\n\n## Standards \u0026 Specifications\n\n### IETF RFC Standards\n\n| Format | RFC Number | Title | Status | Links |\n|--------|------------|-------|--------|-------|\n| **JSON** | RFC 8259 | The JavaScript Object Notation (JSON) Data Interchange Format | Internet Standard (STD 90) | [RFC 8259](https://datatracker.ietf.org/doc/html/rfc8259) |\n| **CBOR** | RFC 8949 | Concise Binary Object Representation (CBOR) | Proposed Standard | [RFC 8949](https://datatracker.ietf.org/doc/html/rfc8949) |\n| **CBOR Serialization** | draft-ietf-cbor-serialization-04 | CBOR Serialization and Determinism | Internet-Draft | [Draft](https://datatracker.ietf.org/doc/html/draft-ietf-cbor-serialization-03) |\n| **CSV** | RFC 4180 | Common Format and MIME Type for Comma-Separated Values | Informational | [RFC 4180](https://datatracker.ietf.org/doc/html/rfc4180) |\n| **COSE** | RFC 8152 | CBOR Object Signing and Encryption (COSE) | Proposed Standard | [RFC 8152](https://datatracker.ietf.org/doc/html/rfc8152) |\n| **JSON Patch** | RFC 6902 | JavaScript Object Notation (JSON) Patch | Proposed Standard | [RFC 6902](https://datatracker.ietf.org/doc/html/rfc6902) |\n| **JSON Pointer** | RFC 6901 | JavaScript Object Notation (JSON) Pointer | Proposed Standard | [RFC 6901](https://datatracker.ietf.org/doc/html/rfc6901) |\n\n### W3C Standards\n\n| Format | Standard | Title | Status | Links |\n|--------|----------|-------|--------|-------|\n| **XML** | XML 1.0 (Fifth Edition) | Extensible Markup Language | W3C Recommendation | [W3C XML](https://www.w3.org/XML/) |\n| **XML Schema (XSD)** | XML Schema 1.1 | W3C XML Schema Definition Language | W3C Recommendation | [XSD](https://www.w3.org/XML/Schema) |\n| **Turtle** | Turtle 1.1 | Terse RDF Triple Language | W3C Recommendation | [Turtle](https://www.w3.org/TR/turtle/) |\n| **JSON-LD** | JSON-LD 1.1 | A JSON-based Serialization for Linked Data | W3C Recommendation | [JSON-LD](https://www.w3.org/TR/json-ld11/) |\n| **EXI** | Efficient XML Interchange (EXI) | Binary XML format | W3C Recommendation | [EXI](https://www.w3.org/TR/exi/) |\n\n### ISO Standards\n\n| Format | Standard | Title | Organization | Links |\n|--------|----------|-------|--------------|-------|\n| **ASN.1** | ITU-T X.680 series | Abstract Syntax Notation One | ITU-T / ISO | [ITU](https://www.itu.int/en/ITU-T/asn1/) |\n| **XDR** | RFC 4506 / ISO | External Data Representation | IETF / ISO | [RFC 4506](https://datatracker.ietf.org/doc/html/rfc4506) |\n| **CDR** | ISO/IEC 10866 | Common Data Representation | ISO | [ISO](https://www.iso.org/) |\n| **STEP (ISO 10303)** | ISO 10303 | Product Data Representation and Exchange | ISO | [ISO 10303](https://www.iso.org/standard/63141.html) |\n\n---\n\n## Tools \u0026 Utilities\n\n| Tool | Type | Formats | Platform | Description | Links |\n|------|------|---------|----------|-------------|-------|\n| **[protoc](https://github.com/protocolbuffers/protobuf)** | Compiler | Protobuf | Cross-platform | Protocol Buffers compiler | [GitHub](https://github.com/protocolbuffers/protobuf) |\n| **[avro-tools](https://avro.apache.org/docs/current/gettingstartedjava.html#tools)** | CLI | Avro | JVM | Schema validation, conversion | [Website](https://avro.apache.org/) |\n| **[jq](https://stedolan.github.io/jq/)** | CLI | JSON | Cross-platform | Command-line JSON processor | [Website](https://stedolan.github.io/jq/) |\n| **[yq](https://github.com/mikefarah/yq)** | CLI | YAML, JSON, XML, TOML, CSV | Cross-platform | Command-line YAML processor | [GitHub](https://github.com/mikefarah/yq) |\n| **[Apache Parquet Tools](https://parquet.apache.org/docs/file-format/)** | CLI | Parquet | JVM | Parquet file inspection | [Docs](https://parquet.apache.org/docs/file-format/) |\n| **[HDFView](https://www.hdfgroup.org/downloads/hdfview/)** | GUI | HDF5 | Cross-platform | HDF5 file viewer and editor | [Download](https://www.hdfgroup.org/downloads/hdfview/) |\n| **[JSON Schema Validator](https://www.jsonschemavalidator.net/)** | Web | JSON Schema | Browser | Online JSON Schema validation | [Website](https://www.jsonschemavalidator.net/) |\n| **[Buf](https://buf.build/)** | CLI | Protobuf | Cross-platform | Modern Protobuf toolchain | [Website](https://buf.build/) |\n| **[Wire](https://square.github.io/wire/)** | CLI/Library | Protobuf | JVM, Android | Square's lightweight Protobuf | [Website](https://square.github.io/wire/) |\n| **[Prototool](https://github.com/uber/prototool)** | CLI | Protobuf | Cross-platform | Uber's Protobuf toolkit (archived) | [GitHub](https://github.com/uber/prototool) |\n| **[Zebra](https://github.com/ColinSu/zebra)** | CLI | Parquet, ORC, Arrow | Cross-platform | Data file format viewer | [GitHub](https://github.com/ColinSu/zebra) |\n\n---\n\n## Learning Resources\n\n### Technical Documentation\n\n- [Protocol Buffers Language Guide](https://developers.google.com/protocol-buffers/docs/proto3) - Official Protobuf documentation\n- [Apache Avro Specification](https://avro.apache.org/docs/current/spec.html) - Avro format specification\n- [CBOR RFC 8949](https://datatracker.ietf.org/doc/html/rfc8949) - IETF CBOR specification\n- [JSON RFC 8259](https://datatracker.ietf.org/doc/html/rfc8259) - IETF JSON specification\n- [YAML 1.2.2 Specification](https://yaml.org/spec/1.2.2/) - Official YAML specification\n- [MessagePack Specification](https://github.com/msgpack/msgpack/blob/master/spec.md) - MessagePack format specification\n- [FlatBuffers Documentation](https://flatbuffers.dev/) - Official FlatBuffers guide\n- [Cap'n Proto Style Guide](https://capnproto.org/language.html) - Cap'n Proto language reference\n- [Apache Arrow Format Specification](https://arrow.apache.org/docs/format/Columnar.html) - Arrow columnar format\n- [Serde Documentation](https://serde.rs/) - Rust serialization framework\n\n### Research Papers\n\n- [Performance Comparison of Messaging Protocols and Serialization Formats](https://www.ida.liu.se/~nikca89/papers/networking20c.pdf) - Proos et al., 2020 (65 citations)\n- [Secure Deserialization of Pickle-based Machine Learning Models](https://dl.acm.org/doi/10.1145/3719027.3765037) - ACM Conference Paper, 2025\n- [Overview of Serialization Technologies (CERN Indico)](https://indico.cern.ch/event/658060/contributions/2898569/attachments/1622526/2582399/pivarski-serialization.pdf) - Pivarski, 2018\n- [Comparison of Data Serialization Formats (Wikipedia)](https://en.wikipedia.org/wiki/Comparison_of_data-serialization_formats) - Comprehensive comparison table\n- [Heep: An FPGA-accelerated Reader for Apache Parquet](https://www.research-collection.ethz.ch/bitstreams/1365f9df-38d0-42f8-b32c-ee1fd40047b5/download) - ETH Zürich, 2025\n- [Benchmarking Apache Arrow Flight](https://dl.acm.org/doi/fullHtml/10.1145/3527199.3527264) - ACM Conference Paper\n- [Evaluating Serialization Formats for Space-Efficient Storage](https://science.lpnu.ua/sites/default/files/journal-paper/2024/jun/35114/vse200624doi-11-17.pdf) - 2024 study\n\n- [eishay/jvm-serializers](https://github.com/eishay/jvm-serializers) - JVM serialization\n- [ProgrammerAL/SerializationBenchmarks](https://github.com/ProgrammerAL/SerializationBenchmarks) - C#/.NET\n\n---\n\n## Related Awesome Lists\n\n- [awesome-json](https://github.com/burningtree/awesome-json) - Curated list of JSON libraries and resources\n- [awesome-serialization](https://github.com/maximveksler/awesome-serialization) - Curated list of serialization formats\n- [awesome-xml](https://github.com/StanimirIglev/awesome-xml) - Curated list of XML standards and libraries\n- [awesome-cpp](https://github.com/fffaraz/awesome-cpp#serialization) - C++ libraries (serialization section)\n- [awesome-python](https://github.com/vinta/awesome-python#serialization) - Python libraries (serialization section)\n- [awesome-go](https://github.com/avelino/awesome-go#serialization) - Go libraries (serialization section)\n- [awesome-rust](https://github.com/rust-unofficial/awesome-rust#serialization) - Rust libraries (serialization section)\n- [awesome-hessian](https://github.com/hessian-group/awesome-hessian) - Hessian serialization resources\n\n---\n\n## Contributing\n\nContributions are welcome! Please submit a Pull Request or open an Issue to suggest additions or changes.\n\n**Contribution Guidelines:**\n- Provide links to official documentation, RFCs, or specifications\n- Note security implications when relevant\n- Specify licenses for libraries\n- Indicate language/version compatibility\n\n---\n\n## License\n\n[![CC0](https://licensebuttons.net/p/zero/1.0/88x31.png)](https://creativecommons.org/publicdomain/zero/1.0/)\n\nTo the extent possible under law, the contributors have waived all copyright and related or neighboring rights to this work.\n\n---\n\n**Have a suggestion?** Open an issue or submit a pull request!\n","projects_url":"https://awesome.ecosyste.ms/api/v1/lists/naranyala%2Fawesome-serialization-deserialization/projects"}