Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

awesome-serialization

Data formats useful for API, Big Data, ML, Graph & co
https://github.com/maximveksler/awesome-serialization

Last synced: 3 days ago
JSON representation

  • Uncategorized

    • Uncategorized

      • Plist - Property List representation. Apple. Textual.
      • npy - Numpy arrays, cell sparse metadata. Binary.
      • SavedModel - TensorFlow package, weights, graph, executable code. Binary.
      • GraphDef - TensorFlow graphs. Binary.
      • Turtle - Terse RDF Triple Language. Textual.
      • TOML - Tom's Obvious, Minimal Language. Textual.
      • Ion - Row storage with skip scan parsing. Structured, schema embedded. Amazon. Textual/Binary.
      • CSV - Comma Separated Values. Textual.
      • JSON5 - JSON with added support for comments and relaxed syntax. Textual.
      • Protocol Buffers - Google's data interchange format. Binary.
      • XML - Extensible Markup Language. Genuinely Horrible. Textual.
      • Cap’n Proto - High-performance, schema-based data interchange format. Binary.
      • TorchScript - Serialization for PyTorch models. Binary.
      • PMML - Predictive Model Markup Language for exchanging ML models.
      • Delta Lake - Transactional storage layer for big data workflows. Binary.
      • Iceberg - Open table format for large datasets. Binary.
      • NetCDF - Self-describing, machine-independent data format for scientific data. Binary.
      • ASDF - Advanced Scientific Data Format for astronomy and beyond. Binary/Textual.
      • CoreML - Apple's on-device ML model format. Binary.
      • MLIR - Intermediate representation for machine learning computations. Textual/Binary.

  • Scientific

    • HDF5® - n-dimensional datasets, complex objects, with schema. Efficient I/O. Binary.

  • Workflow

  • Language specific

  • Academic

    • Java

      • Type theory - studies types, which informally are attributes that objects can possess.
      • Category theory - General theory of functions. Axiomatic foundation for mathematics, as an alternative to set theory.

  • Machine Learning

    • safetensors - Simple, safe way to store and distribute tensors
Programming Languages
Python 3 C++ 1 Swift 1 JavaScript 1
Categories
Uncategorized 20 Language specific 6 Academic 2 Workflow 2 Machine Learning 1 License 1 Scientific 1
Sub Categories
Uncategorized 20 Java 4 Python 3 Swift 1 Dart 1
Keywords
msgpack 2 python 2 serialization 2 json 1 pickle 1 python-2 1 python-3 1 ujson 1 yaml 1 messagepack 1 swift 1 marshalling 1 protobuf 1 protobuf-runtime 1 protoc 1 protocol-buffers 1 protocol-compiler 1 rpc 1