{"id":20761954,"url":"https://github.com/composewell/streamly-lz4","last_synced_at":"2025-04-30T06:29:47.385Z","repository":{"id":43338827,"uuid":"321323704","full_name":"composewell/streamly-lz4","owner":"composewell","description":"Streamly combinators for LZ4 compression.","archived":false,"fork":false,"pushed_at":"2023-03-10T09:02:02.000Z","size":241,"stargazers_count":5,"open_issues_count":13,"forks_count":0,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-04-15T23:09:40.959Z","etag":null,"topics":["compression","lz4","streamly"],"latest_commit_sha":null,"homepage":"","language":"C","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/composewell.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-12-14T11:14:38.000Z","updated_at":"2021-12-03T11:19:26.000Z","dependencies_parsed_at":"2024-11-17T10:28:21.495Z","dependency_job_id":"a77c6fbb-9aad-4023-ab11-57bd755be475","html_url":"https://github.com/composewell/streamly-lz4","commit_stats":{"total_commits":128,"total_committers":2,"mean_commits":64.0,"dds":0.1640625,"last_synced_commit":"a929c20fb582da95783f84a48dc174204cb8601d"},"previous_names":[],"tags_count":3,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/composewell%2Fstreamly-lz4","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/composewell%2Fstreamly-lz4/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/composewell%2Fstreamly-lz4/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/composewell%2Fstreamly-lz4/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/composewell","download_url":"https://codeload.github.com/composewell/streamly-lz4/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251653765,"owners_count":21622186,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["compression","lz4","streamly"],"created_at":"2024-11-17T10:28:13.977Z","updated_at":"2025-04-30T06:29:47.342Z","avatar_url":"https://github.com/composewell.png","language":"C","funding_links":[],"categories":[],"sub_categories":[],"readme":"# streamly-lz4\n\nThis library uses the LZ4 compression algorithm\n\u003chttps://github.com/lz4/lz4\u003e to compress and decompress a data stream\nusing [Haskell Streamly](https://streamly.composewell.com/).\n\n## Running benchmarks\n\n`download-corpora.sh` downloads and unpacks the [caterbury\ncorpus](https://corpus.canterbury.ac.nz/) used for benchmarking.\n\nRun the following commands from the top level directory in the repo:\n```\n$ ./download-corpora.sh\n$ cabal run bench-lz4 -- --quick\n```\n\nTo use [fusion-plugin](https://github.com/composewell/fusion-plugin) for\nbenchmarks:\n\n```\n$ cabal run --flag fusion-plugin bench-lz4 -- --quick\n```\n\n### Benchmarking an external corpus\n\n`BENCH_STREAMLY_LZ4_FILE` is looked up for file to benchmark.  This should\ncontain the absolute path of the target file.\n\n`BENCH_STREAMLY_LZ4_STRATEGY` is looked up for which benchmarking combinator to\nrun on the target file.\n\nIt can contain values of the following structure,\n- `c+speed+bufsize`\n- `d+bufsize`\n- `r+bufsize`\n\n`c` corresponds to compress, `d` for decompress and `r` for resizing.\n\nExample,\n```\n$ export BENCH_STREAMLY_LZ4_FILE=\"path/to/file/\"\n$ export BENCH_STREAMLY_LZ4_STRATEGY=\"c+400+640000\"\n$ cabal bench\n```\n\nThe commands above runs the compression bench suite on **path/to/file/** with\nthe acceleration value of **500** read as arrays of size **640000** bytes.\n\n*Note*: For the decompression and resizing bench suite a compressed file is\nexpected as input.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcomposewell%2Fstreamly-lz4","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcomposewell%2Fstreamly-lz4","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcomposewell%2Fstreamly-lz4/lists"}