https://github.com/roy-ht/joblib-zstd

Zstandard compression/decompression plugin for joblib.
https://github.com/roy-ht/joblib-zstd

Last synced: 2 days ago
JSON representation

Zstandard compression/decompression plugin for joblib.

• Host: GitHub
• URL: https://github.com/roy-ht/joblib-zstd
• Owner: roy-ht
• Created: 2020-05-14T02:10:04.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2020-05-14T23:22:01.000Z (over 4 years ago)
• Last Synced: 2024-10-12T15:49:00.581Z (about 1 month ago)
• Language: Python
• Homepage:
• Size: 18.6 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
joblib-zstd is a plugin, which enables Zstandard (.zst) compression and decompression through joblib.dump and joblib.load.

# Prerequisites

You need [joblib](https://joblib.readthedocs.io/en/latest/).

# Install

```

pip install joblib-zstd

```

If you failed to install, update version of pip and setuptools:

```

pip install -U pip setuptools

```

# Usage

```python

import joblib

import joblib_zstd

joblib_zstd.register()

joblib.dump({'a': 1, 'b': 2}, 'obj.zst', compress=5)  # implicit compression

joblib.dump({'a': 1, 'b': 2}, 'obj.bin', compress=('zstd', 5))  # explicit compression

joblib.load('obj.zst')  # implicit decompression

```

# LISENCE

MIT