{"id":16748786,"url":"https://github.com/loyd/comparison-of-data-formats","last_synced_at":"2025-03-16T03:41:37.608Z","repository":{"id":150877381,"uuid":"110336750","full_name":"loyd/comparison-of-data-formats","owner":"loyd","description":"Comparison of data formats for processing a large realistic record","archived":false,"fork":false,"pushed_at":"2017-11-11T10:42:53.000Z","size":15,"stargazers_count":3,"open_issues_count":1,"forks_count":0,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-01-22T16:23:51.065Z","etag":null,"topics":["avsc","msgpack-lite","msgpack5","protobufjs","pson"],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/loyd.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-11-11T10:29:14.000Z","updated_at":"2020-07-20T13:57:27.000Z","dependencies_parsed_at":"2023-05-24T12:00:41.404Z","dependency_job_id":null,"html_url":"https://github.com/loyd/comparison-of-data-formats","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/loyd%2Fcomparison-of-data-formats","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/loyd%2Fcomparison-of-data-formats/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/loyd%2Fcomparison-of-data-formats/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/loyd%2Fcomparison-of-data-formats/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/loyd","download_url":"https://codeload.github.com/loyd/comparison-of-data-formats/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243822306,"owners_count":20353499,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["avsc","msgpack-lite","msgpack5","protobufjs","pson"],"created_at":"2024-10-13T02:22:52.173Z","updated_at":"2025-03-16T03:41:37.585Z","avatar_url":"https://github.com/loyd.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Comparison of data formats\n\n* Uses a large realistic record.\n* Measures the performance of `decode(decompress(compress(encode(data))))`.\n* Measures the size of `compress(encode(data))`.\n\n## How to run?\n\n```bash\n$ npm install\n$ node test.js [n=20]\n```\n\n## Results\n\n```\n┌──────────────┬───────────┬───────────┬─────────────┬───────────┬───────────┐\n│              │   none    │ gzip (6)  │ deflate (6) │    lz4    │  snappy   │\n├──────────────┼───────────┼───────────┼─────────────┼───────────┼───────────┤\n│ json         │ 346 ops/s │  89 ops/s │    90 ops/s │ 197 ops/s │ 240 ops/s │\n│              │    233 kB │   79.3 kB │     79.3 kB │    136 kB │    135 kB │\n├──────────────┼───────────┼───────────┼─────────────┼───────────┼───────────┤\n│ pson         │  50 ops/s │  37 ops/s │    38 ops/s │  45 ops/s │  48 ops/s │\n│              │    142 kB │   75.1 kB │     75.1 kB │    124 kB │    123 kB │\n├──────────────┼───────────┼───────────┼─────────────┼───────────┼───────────┤\n│ avsc         │ 432 ops/s │ 120 ops/s │   123 ops/s │ 243 ops/s │ 381 ops/s │\n│              │    117 kB │   70.6 kB │     70.5 kB │    114 kB │    117 kB │\n├──────────────┼───────────┼───────────┼─────────────┼───────────┼───────────┤\n│ msgpack5     │  29 ops/s │  25 ops/s │    25 ops/s │  29 ops/s │  30 ops/s │\n│              │    193 kB │     78 kB │       78 kB │    131 kB │    127 kB │\n├──────────────┼───────────┼───────────┼─────────────┼───────────┼───────────┤\n│ msgpack-lite │  84 ops/s │  51 ops/s │    52 ops/s │  66 ops/s │  79 ops/s │\n│              │    193 kB │     78 kB │       78 kB │    131 kB │    127 kB │\n├──────────────┼───────────┼───────────┼─────────────┼───────────┼───────────┤\n│ protobufjs   │ 425 ops/s │ 119 ops/s │   123 ops/s │ 206 ops/s │ 396 ops/s │\n│              │    122 kB │     73 kB │     72.9 kB │    119 kB │    120 kB │\n└──────────────┴───────────┴───────────┴─────────────┴───────────┴───────────┘\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Floyd%2Fcomparison-of-data-formats","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Floyd%2Fcomparison-of-data-formats","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Floyd%2Fcomparison-of-data-formats/lists"}