https://github.com/ascoderu/compression-benchmarks

Benchmark to compare serialization and compression algorithms
https://github.com/ascoderu/compression-benchmarks

aes-encryption avro bson bzip2 cbor gzip jsonlines msgpack python3 sqlite xz zstandard

Last synced: 2 months ago
JSON representation

Benchmark to compare serialization and compression algorithms

• Host: GitHub
• URL: https://github.com/ascoderu/compression-benchmarks
• Owner: ascoderu
• License: apache-2.0
• Created: 2018-12-30T06:32:51.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2023-02-08T00:43:36.000Z (almost 2 years ago)
• Last Synced: 2024-05-01T09:38:04.866Z (9 months ago)
• Topics: aes-encryption, avro, bson, bzip2, cbor, gzip, jsonlines, msgpack, python3, sqlite, xz, zstandard
• Language: Python
• Homepage: https://ascoderu.ca/compression-benchmarks/
• Size: 83 KB
• Stars: 3
• Watchers: 4
• Forks: 3
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt

Awesome Lists containing this project

README

        
# compression-benchmarks

## What's this?

This repository contains serialization, compression and encryption benchmarks for the Lokole [email data exchange protocol](https://github.com/ascoderu/opwen-cloudserver#data-exchange-format) with the aim to find the method of encoding our dataset in the smallest possible size to save bandwidth for users of the system.

> :bulb: Do you know a compression or serialization that could make our data smaller? Then open a pull request! :octocat:

## Setup

Install the requirements with `pip install -r requirements.txt -r requirements-dev.txt`.

Run the tests with `python -m benchmarks.tests` and run the linter with `flake8 benchmarks`.

Run the benchmarks via `python -u -m benchmarks `.

## Results

Benchmark results are kept up to date by [Github Actions](https://github.com/ascoderu/compression-benchmarks/actions?query=workflow%3ACD) at [ascoderu/compression-benchmarks](https://ascoderu.ca/compression-benchmarks/).