{"id":16196290,"url":"https://github.com/nryanov/serializationbenchmark","last_synced_at":"2025-04-02T08:31:14.291Z","repository":{"id":101480265,"uuid":"182462624","full_name":"nryanov/SerializationBenchmark","owner":"nryanov","description":null,"archived":false,"fork":false,"pushed_at":"2019-06-29T21:34:13.000Z","size":145,"stargazers_count":4,"open_issues_count":0,"forks_count":3,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-16T17:51:23.766Z","etag":null,"topics":["avro","benchmark","deserialization","java","json","msgpack","orc","parquet","protobuf","scala","serialization","thrift"],"latest_commit_sha":null,"homepage":null,"language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/nryanov.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-04-20T23:07:33.000Z","updated_at":"2022-08-20T20:49:51.000Z","dependencies_parsed_at":null,"dependency_job_id":"44edcafa-0b82-4c3d-b73d-0651b34523fa","html_url":"https://github.com/nryanov/SerializationBenchmark","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nryanov%2FSerializationBenchmark","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nryanov%2FSerializationBenchmark/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nryanov%2FSerializationBenchmark/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nryanov%2FSerializationBenchmark/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nryanov","download_url":"https://codeload.github.com/nryanov/SerializationBenchmark/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246782091,"owners_count":20832972,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["avro","benchmark","deserialization","java","json","msgpack","orc","parquet","protobuf","scala","serialization","thrift"],"created_at":"2024-10-10T08:47:09.431Z","updated_at":"2025-04-02T08:31:14.276Z","avatar_url":"https://github.com/nryanov.png","language":"Scala","funding_links":[],"categories":[],"sub_categories":[],"readme":"# SerializationBenchmark\n\n`sbt clean compile` - will generate Thrift and Protobuf classes\n\n`sbt generateDataSets` - generate data sets  \n\n`sbt avroSerializingBench` - Run avro serialization  benchmark  \n`sbt avroDeserializingBench` - Run avro deserialization  benchmark  \n`sbt avroBench` - Run avro benchmark  \n\n`sbt cborSerializingBench` - Run cbor serialization  benchmark  \n`sbt cborDeserializingBench` - Run cbor deserialization  benchmark  \n`sbt cborBench` - Run cbor benchmark  \n\n`sbt javaSerializingBench` - Run java serialization benchmark  \n`sbt javaDeserializingBench` - Run java deserialization benchmark  \n`sbt javaBench` - Run java benchmark  \n\n`sbt jsonSerializingBench` - Run json serialization benchmark  \n`sbt jsonDeserializingBench` - Run json deserialization benchmark  \n`sbt jsonBench` - Run json benchmark  \n\n`sbt msgpackSerializingBench` - Run msgpack serialization benchmark  \n`sbt msgpackDeserializingBench` - Run msgpack deserialization benchmark  \n`sbt msgpackBench` - Run msgpack benchmark  \n\n`sbt orcSerializingBench` - Run orc serialization benchmark  \n`sbt orcDeserializingBench` - Run orc deserialization benchmark  \n`sbt orcBench` - Run orc benchmark  \n\n`sbt parquetSerializingBench` - Run parquet serialization benchmark  \n`sbt parquetDeserializingBench` - Run parquet deserialization benchmark  \n`sbt parquetBench` - Run parquet benchmark  \n\n`sbt protobufSerializingBench` - Run protobuf serialization benchmark  \n`sbt protobufDeserializingBench` - Run protobuf deserialization benchmark  \n`sbt protobufBench` - Run protobuf benchmark  \n\n`sbt thriftSerializingBench` - Run thrift serialization benchmark  \n`sbt thriftDeserializingBench` - Run thrift deserialization benchmark  \n`sbt thriftBench` - Run thrift benchmark  \n\n# Formats\n1. Java\n2. Json\n3. Avro\n4. Thrift\n5. Protobuf\n6. ORC\n7. Parquet\n8. Msgpack\n\n# System info\n```cores: 4\nhostname: MAC\nname: Java HotSpot(TM) 64-Bit Server VM\nosArch: x86_64\nosName: Mac OS X\nvendor: Oracle Corporation\nversion: 25,144-b01\n```\n\n# Input data:\n100k records (mixed data - 28m, only longs - 20m, only strings - 71m)\n\n# Results\n\n## Java\n```\n::Benchmark java serialization of mixed data,serialize::\nParameters(input file -\u003e onlyLongs, compression -\u003e none): 2307,343483\nParameters(input file -\u003e onlyLongs, compression -\u003e gzip): 5330,220676\nParameters(input file -\u003e onlyLongs, compression -\u003e snappy): 2358,128772\nParameters(input file -\u003e onlyLongs, compression -\u003e lz4): 2365,895879\nParameters(input file -\u003e mixedData, compression -\u003e none): 3126,791457\nParameters(input file -\u003e mixedData, compression -\u003e gzip): 6081,32952\nParameters(input file -\u003e mixedData, compression -\u003e snappy): 3247,205597\nParameters(input file -\u003e mixedData, compression -\u003e lz4): 3259,827716\nParameters(input file -\u003e onlyStrings, compression -\u003e none): 4860,952922\nParameters(input file -\u003e onlyStrings, compression -\u003e gzip): 13676,610679\nParameters(input file -\u003e onlyStrings, compression -\u003e snappy): 5235,227873\nParameters(input file -\u003e onlyStrings, compression -\u003e lz4): 5081,706156\n\n::Benchmark java deserialization,deserialize::\nParameters(input file -\u003e onlyLongs, compression -\u003e none): 518,977382\nParameters(input file -\u003e onlyLongs, compression -\u003e gzip): 4209,220863\nParameters(input file -\u003e onlyLongs, compression -\u003e snappy): 574,319878\nParameters(input file -\u003e onlyLongs, compression -\u003e lz4): 533,385892\nParameters(input file -\u003e mixedData, compression -\u003e none): 830,198135\nParameters(input file -\u003e mixedData, compression -\u003e gzip): 6175,447826\nParameters(input file -\u003e mixedData, compression -\u003e snappy): 916,241318\nParameters(input file -\u003e mixedData, compression -\u003e lz4): 849,70505\nParameters(input file -\u003e onlyStrings, compression -\u003e none): 1702,41183\nParameters(input file -\u003e onlyStrings, compression -\u003e gzip): 7570,618521\nParameters(input file -\u003e onlyStrings, compression -\u003e snappy): 1740,563435\nParameters(input file -\u003e onlyStrings, compression -\u003e lz4): 1835,862634\n\n28M mixedDataInput,csv\n36M mixedDataJavaSerialization,out\n17M mixedDataJavaSerializationGzip,out\n24M mixedDataJavaSerializationLz4,out\n25M mixedDataJavaSerializationSnappy,out\n\n20M onlyLongsInput,csv\n24M onlyLongsJavaSerialization,out\n9,7M onlyLongsJavaSerializationGzip,out\n12M onlyLongsJavaSerializationLz4,out\n12M onlyLongsJavaSerializationSnappy,out\n\n71M onlyStringsInput,csv\n86M onlyStringsJavaSerialization,out\n42M onlyStringsJavaSerializationGzip,out\n67M onlyStringsJavaSerializationLz4,out\n70M onlyStringsJavaSerializationSnappy,out\n```\n\n## Json\n```\n::Benchmark json serialization,serialize::\nParameters(input file -\u003e onlyLongs, compression -\u003e none): 3378,21702\nParameters(input file -\u003e onlyLongs, compression -\u003e gzip): 7515,758612\nParameters(input file -\u003e onlyLongs, compression -\u003e snappy): 3970,879088\nParameters(input file -\u003e onlyLongs, compression -\u003e lz4): 3462,407938\nParameters(input file -\u003e mixedData, compression -\u003e none): 4152,190077\nParameters(input file -\u003e mixedData, compression -\u003e gzip): 10341,347296\nParameters(input file -\u003e mixedData, compression -\u003e snappy): 4825,457419\nParameters(input file -\u003e mixedData, compression -\u003e lz4): 4215,609799\nParameters(input file -\u003e onlyStrings, compression -\u003e none): 4996,537694\nParameters(input file -\u003e onlyStrings, compression -\u003e gzip): 12896,301143\nParameters(input file -\u003e onlyStrings, compression -\u003e snappy): 7153,249829\nParameters(input file -\u003e onlyStrings, compression -\u003e lz4): 6208,99438\n\n::Benchmark json deserialization,deserialize::\nParameters(input file -\u003e onlyLongs, compression -\u003e none): 1927,306516\nParameters(input file -\u003e onlyLongs, compression -\u003e gzip): 2128,294964\nParameters(input file -\u003e onlyLongs, compression -\u003e snappy): 2206,879477\nParameters(input file -\u003e onlyLongs, compression -\u003e lz4): 2693,439676\nParameters(input file -\u003e mixedData, compression -\u003e none): 2301,310475\nParameters(input file -\u003e mixedData, compression -\u003e gzip): 2673,78582\nParameters(input file -\u003e mixedData, compression -\u003e snappy): 3302,446934\nParameters(input file -\u003e mixedData, compression -\u003e lz4): 2325,333123\nParameters(input file -\u003e onlyStrings, compression -\u003e none): 2826,935487\nParameters(input file -\u003e onlyStrings, compression -\u003e gzip): 3533,28738\nParameters(input file -\u003e onlyStrings, compression -\u003e snappy): 3172,354901\nParameters(input file -\u003e onlyStrings, compression -\u003e lz4): 2906,763224\n\n28M mixedDataInput,csv\n52M mixedDataJsonSerialization,out\n21M mixedDataJsonSerializationGzip,out\n35M mixedDataJsonSerializationLz4,out\n50M mixedDataJsonSerializationSnappy,out\n\n20M onlyLongsInput,csv\n36M onlyLongsJsonSerialization,out\n13M onlyLongsJsonSerializationGzip,out\n23M onlyLongsJsonSerializationLz4,out\n35M onlyLongsJsonSerializationSnappy,out\n\n71M onlyStringsInput,csv\n124M onlyStringsJsonSerialization,out\n55M onlyStringsJsonSerializationGzip,out\n87M onlyStringsJsonSerializationLz4,out\n111M onlyStringsJsonSerializationSnappy,out\n\n```\n\n## Avro\n```\n::Benchmark avro serialization,serialize with schema::\nParameters(data type -\u003e onlyLongs, codec -\u003e none, format -\u003e data): 1023,797601 \nParameters(data type -\u003e onlyLongs, codec -\u003e snappy, format -\u003e data): 1092,880638 \nParameters(data type -\u003e onlyLongs, codec -\u003e deflate, format -\u003e data): 1768,109666 \nParameters(data type -\u003e onlyLongs, codec -\u003e bzip2, format -\u003e data): 3030,31074 \nParameters(data type -\u003e onlyLongs, codec -\u003e xz, format -\u003e data): 6767,382899 \nParameters(data type -\u003e mixedData, codec -\u003e none, format -\u003e data): 1467,348812 \nParameters(data type -\u003e mixedData, codec -\u003e snappy, format -\u003e data): 1529,233246 \nParameters(data type -\u003e mixedData, codec -\u003e deflate, format -\u003e data): 2646,90537 \nParameters(data type -\u003e mixedData, codec -\u003e bzip2, format -\u003e data): 5239,479994 \nParameters(data type -\u003e mixedData, codec -\u003e xz, format -\u003e data): 13762,371548 \nParameters(data type -\u003e onlyStrings, codec -\u003e none, format -\u003e data): 2022,198691 \nParameters(data type -\u003e onlyStrings, codec -\u003e snappy, format -\u003e data): 2128,305766 \nParameters(data type -\u003e onlyStrings, codec -\u003e deflate, format -\u003e data): 6091,337871 \nParameters(data type -\u003e onlyStrings, codec -\u003e bzip2, format -\u003e data): 15218,592615 \nParameters(data type -\u003e onlyStrings, codec -\u003e xz, format -\u003e data): 53867,517186 \n\n::Benchmark deserialization avro,deserialize - data::\nParameters(data type -\u003e onlyLongs, codec -\u003e none, format -\u003e data): 528,70283 \nParameters(data type -\u003e onlyLongs, codec -\u003e snappy, format -\u003e data): 545,836483 \nParameters(data type -\u003e onlyLongs, codec -\u003e deflate, format -\u003e data): 697,207265 \nParameters(data type -\u003e onlyLongs, codec -\u003e bzip2, format -\u003e data): 1666,161023 \nParameters(data type -\u003e onlyLongs, codec -\u003e xz, format -\u003e data): 2216,472777 \nParameters(data type -\u003e mixedData, codec -\u003e none, format -\u003e data): 629,234235 \nParameters(data type -\u003e mixedData, codec -\u003e snappy, format -\u003e data): 626,129412 \nParameters(data type -\u003e mixedData, codec -\u003e deflate, format -\u003e data): 1051,847536 \nParameters(data type -\u003e mixedData, codec -\u003e bzip2, format -\u003e data): 2641,435113 \nParameters(data type -\u003e mixedData, codec -\u003e xz, format -\u003e data): 3560,629288 \nParameters(data type -\u003e onlyStrings, codec -\u003e none, format -\u003e data): 833,421674 \nParameters(data type -\u003e onlyStrings, codec -\u003e snappy, format -\u003e data): 937,640857 \nParameters(data type -\u003e onlyStrings, codec -\u003e deflate, format -\u003e data): 2011,511644 \nParameters(data type -\u003e onlyStrings, codec -\u003e bzip2, format -\u003e data): 6732,656743 \nParameters(data type -\u003e onlyStrings, codec -\u003e xz, format -\u003e data): 10326,75797\n\n14M mixedDataAvroDataSerializationbzip2,out\n16M mixedDataAvroDataSerializationdeflate,out\n22M mixedDataAvroDataSerializationnone,out\n21M mixedDataAvroDataSerializationsnappy,out\n14M mixedDataAvroDataSerializationxz,out\n28M mixedDataInput,csv\n\n8,9M onlyLongsAvroDataSerializationbzip2,out\n9,3M onlyLongsAvroDataSerializationdeflate,out\n11M onlyLongsAvroDataSerializationnone,out\n11M onlyLongsAvroDataSerializationsnappy,out\n8,9M onlyLongsAvroDataSerializationxz,out\n20M onlyLongsInput,csv\n\n37M onlyStringsAvroDataSerializationbzip2,out\n41M onlyStringsAvroDataSerializationdeflate,out\n73M onlyStringsAvroDataSerializationnone,out\n71M onlyStringsAvroDataSerializationsnappy,out\n36M onlyStringsAvroDataSerializationxz,out\n71M onlyStringsInput,csv\n```\n\n## Thrift\n```\n::Benchmark thrift serialization.serialize using binary protocol - mixed data::\nParameters(compression -\u003e none): 1125.383898 ms\nParameters(compression -\u003e gzip): 3801.1242 ms\nParameters(compression -\u003e snappy): 1361.62375 ms\nParameters(compression -\u003e lz4): 1227.557248 ms\n\n::Benchmark thrift serialization.serialize using compact protocol - mixed data::\nParameters(compression -\u003e none): 989.945646 ms\nParameters(compression -\u003e gzip): 2850.871034 ms\nParameters(compression -\u003e snappy): 1049.290478 ms\nParameters(compression -\u003e lz4): 1034.213286 ms\n\n::Benchmark thrift serialization.serialize using binary protocol - only strings::\nParameters(compression -\u003e none): 1736.157983 ms\nParameters(compression -\u003e gzip): 7854.017803 ms\nParameters(compression -\u003e snappy): 2061.513139 ms\nParameters(compression -\u003e lz4): 2520.092522 ms\n\n::Benchmark thrift serialization.serialize using compact protocol - only strings::\nParameters(compression -\u003e none): 2083.990485 ms\nParameters(compression -\u003e gzip): 9119.918932 ms\nParameters(compression -\u003e snappy): 2562.690542 ms\nParameters(compression -\u003e lz4): 2477.448584 ms\n\n::Benchmark thrift serialization.serialize using binary protocol - only longs::\nParameters(compression -\u003e none): 850.172428 ms\nParameters(compression -\u003e gzip): 3191.32861 ms\nParameters(compression -\u003e snappy): 900.007347 ms\nParameters(compression -\u003e lz4): 891.543165 ms\n\n::Benchmark thrift serialization.serialize using compact protocol - only longs::\nParameters(compression -\u003e none): 855.884258 ms\nParameters(compression -\u003e gzip): 2024.724032 ms\nParameters(compression -\u003e snappy): 929.506194 ms\nParameters(compression -\u003e lz4): 927.156058 ms\n\n::Benchmark thrift deserialization.binary deserialization - mixed data::\nParameters(compression -\u003e none): 213.600809 ms\nParameters(compression -\u003e gzip): 712.985832 ms\nParameters(compression -\u003e snappy): 248.259036 ms\nParameters(compression -\u003e lz4): 227.736503 ms\n\n::Benchmark thrift deserialization.compact deserialization - mixed data::\nParameters(compression -\u003e none): 205.388832 ms\nParameters(compression -\u003e gzip): 770.899966 ms\nParameters(compression -\u003e snappy): 236.259813 ms\nParameters(compression -\u003e lz4): 254.548418 ms\n\n::Benchmark thrift deserialization.binary deserialization - only strings::\nParameters(compression -\u003e none): 459.104972 ms\nParameters(compression -\u003e gzip): 1375.754233 ms\nParameters(compression -\u003e snappy): 604.896944 ms\nParameters(compression -\u003e lz4): 561.856199 ms\n\n::Benchmark thrift deserialization.compact deserialization - only strings::\nParameters(compression -\u003e none): 444.190074 ms\nParameters(compression -\u003e gzip): 1298.840792 ms\nParameters(compression -\u003e snappy): 567.996401 ms\nParameters(compression -\u003e lz4): 622.159067 ms\n\n::Benchmark thrift deserialization.binary deserialization - only longs::\nParameters(compression -\u003e none): 119.657143 ms\nParameters(compression -\u003e gzip): 474.217573 ms\nParameters(compression -\u003e snappy): 123.937332 ms\nParameters(compression -\u003e lz4): 130.392506 ms\n\n::Benchmark thrift deserialization.compact deserialization - only longs::\nParameters(compression -\u003e none): 234.736586 ms\nParameters(compression -\u003e gzip): 623.688881 ms\nParameters(compression -\u003e snappy): 254.769316 ms\nParameters(compression -\u003e lz4): 252.935347 ms\n\n\n37M mixedDataBinaryThriftSerialization.out\n17M mixedDataBinaryThriftSerializationGzip.out\n22M mixedDataBinaryThriftSerializationLz4.out\n23M mixedDataBinaryThriftSerializationSnappy.out\n31M mixedDataCompactThriftSerialization.out\n17M mixedDataCompactThriftSerializationGzip.out\n21M mixedDataCompactThriftSerializationLz4.out\n22M mixedDataCompactThriftSerializationSnappy.out\n28M mixedDataInput.csv\n\n16M onlyLongsBinaryThriftSerialization.out\n9.7M onlyLongsBinaryThriftSerializationGzip.out\n11M onlyLongsBinaryThriftSerializationLz4.out\n11M onlyLongsBinaryThriftSerializationSnappy.out\n14M onlyLongsCompactThriftSerialization.out\n9.4M onlyLongsCompactThriftSerializationGzip.out\n11M onlyLongsCompactThriftSerializationLz4.out\n11M onlyLongsCompactThriftSerializationSnappy.out\n20M onlyLongsInput.csv\n\n98M onlyStringsBinaryThriftSerialization.out\n44M onlyStringsBinaryThriftSerializationGzip.out\n70M onlyStringsBinaryThriftSerializationLz4.out\n74M onlyStringsBinaryThriftSerializationSnappy.out\n98M onlyStringsCompactThriftSerialization.out\n42M onlyStringsCompactThriftSerializationGzip.out\n66M onlyStringsCompactThriftSerializationLz4.out\n72M onlyStringsCompactThriftSerializationSnappy.out\n71M onlyStringsInput.csv\n```\n\n## Protobuf\n```\n::Benchmark protobuf serialization.serialize - mixed data::\nParameters(compression -\u003e none): 1102.173422 ms\nParameters(compression -\u003e gzip): 3683.866389 ms\nParameters(compression -\u003e snappy): 1120.608083 ms\nParameters(compression -\u003e lz4): 1155.255245 ms\n\n::Benchmark protobuf serialization.serialize - only strings::\nParameters(compression -\u003e none): 1929.046419 ms\nParameters(compression -\u003e gzip): 9241.951999 ms\nParameters(compression -\u003e snappy): 1935.746472 ms\nParameters(compression -\u003e lz4): 2118.653265 ms\n\n::Benchmark protobuf serialization.serialize - only longs::\nParameters(compression -\u003e none): 768.131208 ms\nParameters(compression -\u003e gzip): 2170.330163 ms\nParameters(compression -\u003e snappy): 856.351572 ms\nParameters(compression -\u003e lz4): 815.517398 ms\n\n\n::Benchmark protobuf deserialization.deserialize - mixed data::\nParameters(compression -\u003e none): 90.701471 ms\nParameters(compression -\u003e gzip): 675.418776 ms\nParameters(compression -\u003e snappy): 111.94735 ms\nParameters(compression -\u003e lz4): 118.566453 ms\n\n::Benchmark protobuf deserialization.deserialize - only strings::\nParameters(compression -\u003e none): 265.139096 ms\nParameters(compression -\u003e gzip): 1285.807188 ms\nParameters(compression -\u003e snappy): 272.894545 ms\nParameters(compression -\u003e lz4): 324.312626 ms\n\n::Benchmark protobuf deserialization.deserialize - only longs::\nParameters(compression -\u003e none): 62.238189 ms\nParameters(compression -\u003e gzip): 498.403267 ms\nParameters(compression -\u003e snappy): 64.990243 ms\nParameters(compression -\u003e lz4): 65.485835 ms\n\n28M mixedDataInput.csv\n22M mixedDataProtobufSerialization.out\n16M mixedDataProtobufSerializationGzip.out\n21M mixedDataProtobufSerializationLz4.out\n22M mixedDataProtobufSerializationSnappy.out\n\n20M onlyLongsInput.csv\n11M onlyLongsProtobufSerialization.out\n9.6M onlyLongsProtobufSerializationGzip.out\n11M onlyLongsProtobufSerializationLz4.out\n11M onlyLongsProtobufSerializationSnappy.out\n\n71M onlyStringsInput.csv\n73M onlyStringsProtobufSerialization.out\n42M onlyStringsProtobufSerializationGzip.out\n68M onlyStringsProtobufSerializationLz4.out\n73M onlyStringsProtobufSerializationSnappy.out\n\n```\n\n## ORC\n```\n::Benchmark orc serialization.serialize - mixed data::\nParameters(compression -\u003e NONE): 1912.585564 ms\nParameters(compression -\u003e SNAPPY): 2288.6607 ms\nParameters(compression -\u003e ZLIB): 2891.391571 ms\nParameters(compression -\u003e LZO): 2237.013887 ms\nParameters(compression -\u003e LZ4): 1930.257375 ms\n\n::Benchmark orc serialization.serialize - only strings::\nParameters(compression -\u003e NONE): 2344.838182 ms\nParameters(compression -\u003e SNAPPY): 2887.628871 ms\nParameters(compression -\u003e ZLIB): 4633.018129 ms\nParameters(compression -\u003e LZO): 2541.053979 ms\nParameters(compression -\u003e LZ4): 2541.089112 ms\n\n::Benchmark orc serialization.serialize - only longs::\nParameters(compression -\u003e NONE): 936.24197 ms\nParameters(compression -\u003e SNAPPY): 961.510494 ms\nParameters(compression -\u003e ZLIB): 1275.094674 ms\nParameters(compression -\u003e LZO): 1028.821117 ms\nParameters(compression -\u003e LZ4): 1003.875842 ms\n\n::Benchmark orc deserialization.deserialize - mixed data::\nParameters(compression -\u003e NONE): 189.255381 ms\nParameters(compression -\u003e SNAPPY): 256.261948 ms\nParameters(compression -\u003e ZLIB): 340.04471 ms\nParameters(compression -\u003e LZO): 199.372492 ms\nParameters(compression -\u003e LZ4): 206.638675 ms\n\n::Benchmark orc deserialization.deserialize - only strings::\nParameters(compression -\u003e NONE): 316.492181 ms\nParameters(compression -\u003e SNAPPY): 536.2908 ms\nParameters(compression -\u003e ZLIB): 773.823267 ms\nParameters(compression -\u003e LZO): 367.960728 ms\nParameters(compression -\u003e LZ4): 331.145197 ms\n\n::Benchmark orc deserialization.deserialize - only longs::\nParameters(compression -\u003e NONE): 95.842699 ms\nParameters(compression -\u003e SNAPPY): 116.003717 ms\nParameters(compression -\u003e ZLIB): 154.301854 ms\nParameters(compression -\u003e LZO): 105.768183 ms\nParameters(compression -\u003e LZ4): 103.962426 ms\n\n\n28M mixedDataInput.csv\n21M mixedDataOrcSerializationLZ4.orc\n21M mixedDataOrcSerializationLZO.orc\n21M mixedDataOrcSerializationNONE.orc\n20M mixedDataOrcSerializationSNAPPY.orc\n14M mixedDataOrcSerializationZLIB.orc\n\n20M onlyLongsInput.csv\n9.5M onlyLongsOrcSerializationLZ4.orc\n9.5M onlyLongsOrcSerializationLZO.orc\n12M onlyLongsOrcSerializationNONE.orc\n9.3M onlyLongsOrcSerializationSNAPPY.orc\n8.8M onlyLongsOrcSerializationZLIB.orc\n\n71M onlyStringsInput.csv\n69M onlyStringsOrcSerializationLZ4.orc\n69M onlyStringsOrcSerializationLZO.orc\n69M onlyStringsOrcSerializationNONE.orc\n65M onlyStringsOrcSerializationSNAPPY.orc\n40M onlyStringsOrcSerializationZLIB.orc\n\n```\n\n## Parquet\n```\n::Benchmark parquet serialization.parquet-avro serialize - mixed data::\nParameters(compression -\u003e UNCOMPRESSED): 10218.814451 ms\nParameters(compression -\u003e SNAPPY): 10442.95336 ms\nParameters(compression -\u003e GZIP): 11533.360107 ms\n\n::Benchmark parquet serialization.parquet-thrift serialize - mixed data::\nParameters(compression -\u003e UNCOMPRESSED): 13831.127764 ms\nParameters(compression -\u003e SNAPPY): 17349.627433 ms\nParameters(compression -\u003e GZIP): 15447.89787 ms\n\n::Benchmark parquet serialization.parquet-avro serialize - only strings::\nParameters(compression -\u003e UNCOMPRESSED): 16779.399392 ms\nParameters(compression -\u003e SNAPPY): 17172.47809 ms\nParameters(compression -\u003e GZIP): 22477.547579 ms\n\n::Benchmark parquet serialization.parquet-thrift serialize - only strings::\nParameters(compression -\u003e UNCOMPRESSED): 17856.227515 ms\nParameters(compression -\u003e SNAPPY): 18600.951512 ms\nParameters(compression -\u003e GZIP): 23818.573715 ms\n\n::Benchmark parquet serialization.parquet-avro serialize - only longs::\nParameters(compression -\u003e UNCOMPRESSED): 7005.872151 ms\nParameters(compression -\u003e SNAPPY): 7121.721859 ms\nParameters(compression -\u003e GZIP): 7614.317721 ms\n\n::Benchmark parquet serialization.parquet-thrift serialize - only longs::\nParameters(compression -\u003e UNCOMPRESSED): 13440.809873 ms\nParameters(compression -\u003e SNAPPY): 13529.675534 ms\nParameters(compression -\u003e GZIP): 17242.291184 ms\n\n::Benchmark parquet deserialization.deserialize-avro - mixed data::\nParameters(compression -\u003e UNCOMPRESSED): 1116.220223 ms\nParameters(compression -\u003e SNAPPY): 1160.43776 ms\nParameters(compression -\u003e GZIP): 1270.950129 ms\n\n::Benchmark parquet deserialization.deserialize-thrift - mixed data::\nParameters(compression -\u003e UNCOMPRESSED): 1306.652127 ms\nParameters(compression -\u003e SNAPPY): 1442.344638 ms\nParameters(compression -\u003e GZIP): 1592.810931 ms\n\n::Benchmark parquet deserialization.deserialize-avro - only strings::\nParameters(compression -\u003e UNCOMPRESSED): 1631.461872 ms\nParameters(compression -\u003e SNAPPY): 1691.013253 ms\nParameters(compression -\u003e GZIP): 2136.751124 ms\n\n::Benchmark parquet deserialization.deserialize-thrift - only strings::\nParameters(compression -\u003e UNCOMPRESSED): 1319.10091 ms\nParameters(compression -\u003e SNAPPY): 1435.536838 ms\nParameters(compression -\u003e GZIP): 1868.112762 ms\n\n::Benchmark parquet deserialization.deserialize-avro - only longs::\nParameters(compression -\u003e UNCOMPRESSED): 767.6748 ms\nParameters(compression -\u003e SNAPPY): 815.833926 ms\nParameters(compression -\u003e GZIP): 855.741205 ms\n\n::Benchmark parquet deserialization.deserialize-thrift - only longs::\nParameters(compression -\u003e UNCOMPRESSED): 937.663629 ms\nParameters(compression -\u003e SNAPPY): 1111.400913 ms\nParameters(compression -\u003e GZIP): 1284.935349 ms\n\n\n28M mixedDataInput.csv\n13M mixedDataParquetAvroSerializationGZIP.out\n19M mixedDataParquetAvroSerializationSNAPPY.out\n21M mixedDataParquetAvroSerializationUNCOMPRESSED.out\n14M mixedDataParquetThriftSerializationGZIP.out\n20M mixedDataParquetThriftSerializationSNAPPY.out\n22M mixedDataParquetThriftSerializationUNCOMPRESSED.out\n\n20M onlyLongsInput.csv\n7.7M onlyLongsParquetAvroSerializationGZIP.out\n7.7M onlyLongsParquetAvroSerializationSNAPPY.out\n7.9M onlyLongsParquetAvroSerializationUNCOMPRESSED.out\n9.7M onlyLongsParquetThriftSerializationGZIP.out\n11M onlyLongsParquetThriftSerializationSNAPPY.out\n11M onlyLongsParquetThriftSerializationUNCOMPRESSED.out\n\n71M onlyStringsInput.csv\n42M onlyStringsParquetAvroSerializationGZIP.out\n69M onlyStringsParquetAvroSerializationSNAPPY.out\n76M onlyStringsParquetAvroSerializationUNCOMPRESSED.out\n42M onlyStringsParquetThriftSerializationGZIP.out\n69M onlyStringsParquetThriftSerializationSNAPPY.out\n76M onlyStringsParquetThriftSerializationUNCOMPRESSED.out\n\n```\n\n## Msgpack\n```\n::Benchmark msgpack serialization.serialize - mixed data::\nParameters(compression -\u003e none): 1020.163951 ms\nParameters(compression -\u003e gzip): 3114.796838 ms\nParameters(compression -\u003e snappy): 1065.383296 ms\nParameters(compression -\u003e lz4): 1117.194498 ms\n\n::Benchmark msgpack serialization.serialize - only strings::\nParameters(compression -\u003e none): 1897.480828 ms\nParameters(compression -\u003e gzip): 8753.47287 ms\nParameters(compression -\u003e snappy): 1903.218432 ms\nParameters(compression -\u003e lz4): 2228.870718 ms\n\n::Benchmark msgpack serialization.serialize - only longs::\nParameters(compression -\u003e none): 746.000071 ms\nParameters(compression -\u003e gzip): 1709.087779 ms\nParameters(compression -\u003e snappy): 808.893869 ms\nParameters(compression -\u003e lz4): 811.050544 ms\n\n\n::Benchmark msgpack deserialization.deserialize - mixed data::\nParameters(compression -\u003e none): 299.681239 ms\nParameters(compression -\u003e gzip): 526.834939 ms\nParameters(compression -\u003e snappy): 306.481637 ms\nParameters(compression -\u003e lz4): 322.101246 ms\n\n::Benchmark msgpack deserialization.deserialize - only strings::\nParameters(compression -\u003e none): 417.600146 ms\nParameters(compression -\u003e gzip): 1083.538239 ms\nParameters(compression -\u003e snappy): 481.48993 ms\nParameters(compression -\u003e lz4): 544.200988 ms\n\n::Benchmark msgpack deserialization.deserialize - only longs::\nParameters(compression -\u003e none): 83.994804 ms\nParameters(compression -\u003e gzip): 159.456138 ms\nParameters(compression -\u003e snappy): 87.196718 ms\nParameters(compression -\u003e lz4): 87.100244 ms\n\n28M  mixedDataInput.csv\n21M  mixedDataMsgpackSerialization.out\n16M  mixedDataMsgpackSerializationGzip.out\n20M  mixedDataMsgpackSerializationLz4.out\n21M  mixedDataMsgpackSerializationSnappy.out\n\n20M  onlyLongsInput.csv\n9.6M onlyLongsMsgpackSerialization.out\n9.0M onlyLongsMsgpackSerializationGzip.out\n9.6M onlyLongsMsgpackSerializationLz4.out\n9.6M onlyLongsMsgpackSerializationSnappy.out\n\n71M  onlyStringsInput.csv\n73M  onlyStringsMsgpackSerialization.out\n41M  onlyStringsMsgpackSerializationGzip.out\n66M  onlyStringsMsgpackSerializationLz4.out\n73M  onlyStringsMsgpackSerializationSnappy.out\n\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnryanov%2Fserializationbenchmark","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnryanov%2Fserializationbenchmark","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnryanov%2Fserializationbenchmark/lists"}