https://github.com/libmir/mir-ion
Ion, JSON, YAML, CSV, CBOR and Msgpack serialization framework
https://github.com/libmir/mir-ion
amazon-ion csv dlang ion json msgpack serialization yaml
Last synced: 7 months ago
JSON representation
Ion, JSON, YAML, CSV, CBOR and Msgpack serialization framework
- Host: GitHub
- URL: https://github.com/libmir/mir-ion
- Owner: libmir
- License: apache-2.0
- Created: 2021-12-05T13:50:05.000Z (about 4 years ago)
- Default Branch: master
- Last Pushed: 2024-12-17T19:52:18.000Z (about 1 year ago)
- Last Synced: 2025-04-01T18:08:48.120Z (11 months ago)
- Topics: amazon-ion, csv, dlang, ion, json, msgpack, serialization, yaml
- Language: D
- Homepage:
- Size: 3.08 MB
- Stars: 14
- Watchers: 7
- Forks: 7
- Open Issues: 11
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
[](http://code.dlang.org/packages/mir-ion)
[](http://code.dlang.org/packages/mir-ion)
[](http://code.dlang.org/packages/mir-ion)
[](https://codecov.io/gh/libmir/mir-ion)
[](https://circleci.com/gh/libmir/mir-ion/tree/master)
# Mir Ion
Mir Ion serialization engine supports
- Text and binary [Ion](http://amzn.github.io/ion-docs)
- JSON
- MsgPack
- YAML
- CSV
- CBOR (encoding only)
- [Bloomberg](https://github.com/libmir/mir-bloomberg)
- [Custom formats](docs-src/custom-formats.md)
## Documentation
You can find the documentation for this library [here](http://mir-ion.libmir.org/).
Additionally, for examples of the Ion format, you can check the [Ion Cookbook](https://amzn.github.io/ion-docs/guides/cookbook.html)
## Benchmarks
### [kostya JSON benchmarks](https://github.com/kostya/benchmarks#json)
### ARM64
#### Twitter data set
Test data from [nativejson-benchmark](https://github.com/miloyip/nativejson-benchmark/blob/master/data/twitter.json)
```
-------------------------------------------------
Binary Ion writing 0.601 GB/s
is equivalent of 1.598 GB/s for JSON
JSON -> binary Ion 1.16 GB/s
MsgPack -> binary Ion 0.841 GB/s
is equivalent of 1.321 GB/s for JSON
Ion is 96% smaller then minimized JSON
and 69% smaller then MsgPack
- - - - - - - - - - - - - - - - - - - - - - - - -
processed file: benchmark/twitter.json
number of iterations: 2000
os: 64bit osx
-------------------------------------------------
```
#### Kostya data set
Test data from [kostya/benchmarks](https://github.com/kostya/benchmarks).
```
-------------------------------------------------
Binary Ion writing 0.251 GB/s
is equivalent of 1.063 GB/s for JSON
JSON -> binary Ion 0.6 GB/s
MsgPack -> binary Ion 0.309 GB/s
is equivalent of 1.098 GB/s for JSON
Ion is 134% smaller then minimized JSON
and 19% smaller then MsgPack
- - - - - - - - - - - - - - - - - - - - - - - - -
processed file: /tmp/1.json
number of iterations: 10
os: 64bit osx
-------------------------------------------------
```
## Exceptions
Mir Ion internals are `@nogc` and almost all are preallocated. If DIP1008 is enabled, then the parsing exception will contains additional information about error location in the file and last occured key.
## Feature Status
- [x] Binary Ion Value parsing and skip-scan iteration.
- [x] Binary Ion conversions to D types.
- [x] Binary Ion conversions from D types.
- [x] Fast hash table for Ion Symbol Tables
- [x] Fast CTFE Symbol Table for deserialization
- [x] Ion Symbol Tables
- [x] JSON to Ion
- [x] Ion to JSON
- [x] Text Ion to Ion
- [x] Ion to Text Ion
- [x] Serialization API
- [x] Deserialization API
- [x] Precise decimal to floating conversion (except subnormals)
- [x] Precise floating to decimal conversion.
- [x] Local Symbol Tables
- [ ] Shared Symbol Tables
- [x] Chunked JSON reader
- [x] Chunked binary Ion Value Stream reader
- [x] MessagePack parsing
- [x] Ion to MessagePack