An open API service indexing awesome lists of open source software.

https://github.com/gorhill/s14e-serializer

A library to de/serialize structured-cloneable data to a Unicode string, optionally with LZ4 compression
https://github.com/gorhill/s14e-serializer

Last synced: about 1 year ago
JSON representation

A library to de/serialize structured-cloneable data to a Unicode string, optionally with LZ4 compression

Awesome Lists containing this project

README

          

[![Badge NPM]][NPM]

## Structured-Cloneable to Unicode-Only serializer/deserializer

Serialize/deserialize JavaScript data to/from well-formed Unicode strings.

The resulting string is meant to be small. As a result, it is not
human-readable, though it contains only printable ASCII characters -- and
possibly Unicode characters beyond ASCII.

The resulting JS string will not contain characters which require escaping
should it be converted to a JSON value. However it may contain characters which
require escaping should it be converted to a URI component.

Note: strings are serialized as is, so if they contain non-printable ASCII
characters or characters which requires escaping, then the result of the
serialization will reflect this.

Characteristics:

- Serializes/deserializes data to/from a single well-formed Unicode string
- Strings do not require escaping, i.e. they are stored as-is
- Supports multiple references to same object
- Supports reference cycles
- Supports synchronous and asynchronous API
- Optionally supports LZ4 compression

### Motivation

The browser does not expose an API to serialize structured-cloneable types into
a single string. `JSON.stringify()` does not support complex JavaScript objects,
and does not support references to composite types. Unless the data to serialize
is only JS strings, it is difficult to easily switch from one type of storage to
another.

Serializing to a well-formed Unicode string allows to store structured-cloneable
data to any storage. Not all storages support storing binary data, but all
storages support storing Unicode strings.

Data types | String | JSONable | structured-cloneable
--------------- | ---------------- | ---------------- | ---------------------
document.cookie | Yes | No | No
localStorage | Yes | No | No
IndexedDB | Yes | Yes | Yes
browser.storage | Yes | Yes | No
Cache API | Yes | No | No

The above table shows that only JS strings can be persisted natively to all
types of storage. The purpose of this library is to convert structure-cloneable
data (which is a superset of JSONable data) into a single JS string.

### Usage

See [test/test.js](./test/test.js) for typical usage.

#### In Node.js:

```js
import { serialize } from '@gorhill/s14e-serializer';

// ...

// Serialize data into string
const s1 = serialize(data1);

// Serialize and compress data into string
const s2 = serialize(data2, { compress: true });

// Write strings to some storage

// ...
```

```js
import { deserialize } from '@gorhill/s14e-serializer';

// Read strings from some storage

// ...

// Restore data from string
const data1 = deserialize(s1);

// Restore data from string
const data2 = deserialize(s2);

// ...
```

#### In browser

Copy `s14e-serializer.js` into your project, then:

```js
import {
deserialize,
deserializeAsync,
serialize,
serializeAsync,
} from './s14e-serializer.js';

// ...
```

### Serializable types

- literals
- array
- bigint
- boolean
- number
- object
- regex
- string
- `null`
- `undefined`
- `ArrayBuffer`
- `Boolean`
- `DataView`
- `Date`
- `Map`
- `Number`
- `Object`
- `RegExp`
- `Set`
- `String`
- `TypedArray`
- `Int8Array`
- `Uint8Array`
- `Uint8ClampedArray`
- `Int16Array`
- `Uint16Array`
- `Int32Array`
- `Uint32Array`
- `Float32Array`
- `Float64Array`

### Validation

The linter should return no errors or warnings:

npm run lint

The test suite should not fail:

npm run test

### Future

Possible improvements:

- Add support for more built-in types
- Add support for checksums
- Add support for custom types
- If so the name of the library might no longer make sense...

Contributions are welcome.

[NPM]: https://www.npmjs.com/package/@gorhill/s14e-serializer

[Badge NPM]: https://img.shields.io/npm/v/@gorhill/s14e-serializer