{"id":13489185,"url":"https://github.com/mcmilk/zstdmt","last_synced_at":"2025-04-13T07:48:14.622Z","repository":{"id":55929441,"uuid":"63838601","full_name":"mcmilk/zstdmt","owner":"mcmilk","description":"Multithreading Library for Brotli, Lizard, LZ4, LZ5, Snappy and Zstandard","archived":false,"fork":false,"pushed_at":"2025-02-02T13:11:42.000Z","size":975,"stargazers_count":198,"open_issues_count":2,"forks_count":36,"subscribers_count":18,"default_branch":"master","last_synced_at":"2025-04-13T07:48:04.685Z","etag":null,"topics":["brotli","lizard","lz4","lz5","multithreading-library","skippables-frame","snappy","zstandard","zstd"],"latest_commit_sha":null,"homepage":"","language":"C","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mcmilk.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGES.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-07-21T05:04:46.000Z","updated_at":"2025-04-09T09:27:08.000Z","dependencies_parsed_at":"2024-01-16T09:00:58.959Z","dependency_job_id":"b404165b-d30b-4b09-bfc5-70c817208158","html_url":"https://github.com/mcmilk/zstdmt","commit_stats":null,"previous_names":[],"tags_count":9,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mcmilk%2Fzstdmt","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mcmilk%2Fzstdmt/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mcmilk%2Fzstdmt/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mcmilk%2Fzstdmt/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mcmilk","download_url":"https://codeload.github.com/mcmilk/zstdmt/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248681494,"owners_count":21144700,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["brotli","lizard","lz4","lz5","multithreading-library","skippables-frame","snappy","zstandard","zstd"],"created_at":"2024-07-31T19:00:19.308Z","updated_at":"2025-04-13T07:48:14.592Z","avatar_url":"https://github.com/mcmilk.png","language":"C","readme":"\n# Multithreading Library for [Brotli], [Lizard], [LZ4], [LZ5], [Snappy-c], [LZFSE] and [Zstandard]\n\n## Description\n- works with skippables frame id 0x184D2A50 (12 bytes per compressed frame)\n- brotli is supported the same way, it will encapsulate the real brotli stream\n  within an 16 byte frame header\n\n## Generic skippable frame definition\n\n- the frame header for [Lizard], [LZ4], [LZ5] and [Zstandard] is like this:\n\nsize    | value             | description\n--------|-------------------|------------\n4 bytes | 0x184D2A50U       | magic for skippable frame\n4 bytes | 4                 | size of skippable frame\n4 bytes | compressed size   | size of the following frame (compressed data)\n\n\n## [Brotli] frame definition\n\n- the frame header for brotli is defined a bit different:\n\nsize    | value             | description\n--------|-------------------|------------\n4 bytes | 0x184D2A50U       | magic for skippable frame (like zstd)\n4 bytes | 8                 | size of skippable frame\n4 bytes | compressed size   | size of the following frame (compressed data)\n2 bytes | 0x5242U           | magic for brotli \"BR\"\n2 bytes | uncompressed size | allocation hint for decompressor (64KB * this size)\n\n## [Snappy-c] frame definition\n\n- the frame header for Snappy-c is defined a bit different:\n\nsize    | value             | description\n--------|-------------------|------------\n4 bytes | 0x184D2A50U       | magic for skippable frame (like zstd)\n4 bytes | 8                 | size of skippable frame\n4 bytes | compressed size   | size of the following frame (compressed data)\n2 bytes | 0x5053U           | magic for Snappy-c \"SP\"\n2 bytes | uncompressed size | allocation hint for decompressor (64KB * this size)\n\n## [LZFSE] frame definition\n\n- the frame header for Lzfse is defined a bit different:\n\nsize    | value             | description\n--------|-------------------|------------\n4 bytes | 0x184D2A50U       | magic for skippable frame (like zstd)\n4 bytes | 8                 | size of skippable frame\n4 bytes | compressed size   | size of the following frame (compressed data)\n2 bytes | 0x464CU           | magic for Lzfse \"LF\"\n2 bytes | uncompressed size | allocation hint for decompressor (64KB * this size)\n\n## Usage of the Testutils\n- see [programs](https://github.com/mcmilk/zstdmt/tree/master/programs)\n\n## Usage of the Library\n\n- see [lib](https://github.com/mcmilk/zstdmt/tree/master/lib)\n\n[Brotli]:https://github.com/google/brotli/\n[LZ4]:https://github.com/lz4/lz4/\n[LZ5]:https://github.com/inikep/lz5/\n[Zstandard]:https://github.com/facebook/zstd/\n[Lizard]:https://github.com/inikep/lizard/\n[Snappy-c]:https://github.com/andikleen/snappy-c\n[LZFSE]:https://github.com/lzfse/lzfse\n\n/TR 2020-10-15\n","funding_links":[],"categories":["C"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmcmilk%2Fzstdmt","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmcmilk%2Fzstdmt","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmcmilk%2Fzstdmt/lists"}