Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/LLNL/zfp
Compressed numerical arrays that support high-speed random access
https://github.com/LLNL/zfp
arrays compression data-viz floating-point radiuss
Last synced: 10 days ago
JSON representation
Compressed numerical arrays that support high-speed random access
- Host: GitHub
- URL: https://github.com/LLNL/zfp
- Owner: LLNL
- License: bsd-3-clause
- Created: 2016-03-24T02:10:02.000Z (over 8 years ago)
- Default Branch: develop
- Last Pushed: 2024-10-16T21:58:15.000Z (26 days ago)
- Last Synced: 2024-10-19T15:07:46.194Z (23 days ago)
- Topics: arrays, compression, data-viz, floating-point, radiuss
- Language: C++
- Homepage: http://zfp.llnl.gov
- Size: 3.91 MB
- Stars: 769
- Watchers: 29
- Forks: 158
- Open Issues: 41
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Citation: CITATION.cff
- Support: SUPPORT.md
Awesome Lists containing this project
- awesome-oneapi - ZFP - zfp is a compressed format for representing multidimensional floating-point and integer arrays. zfp provides compressed-array classes that support high throughput read and write random access to individual array elements. zfp also supports serial and parallel compression of whole arrays for applications that read and write large data sets to and from disk. (Table of Contents / Tools and Development)
README
ZFP
===
[](https://github.com/LLNL/zfp/actions/workflows/tests.yml)
[](https://ci.appveyor.com/project/lindstro/zfp)
[](https://zfp.readthedocs.io/en/release1.0.1/)
[](https://codecov.io/gh/LLNL/zfp)
[](https://www.rdworldonline.com/rd-100-winners-for-2023-are-announced-2/)
zfp is a compressed format for representing multidimensional floating-point
and integer arrays. zfp provides compressed-array classes that support high
throughput read and write random access to individual array elements. zfp
also supports serial and parallel (OpenMP and CUDA) compression of whole
arrays, e.g., for applications that read and write large data sets to and
from disk.
zfp uses lossy but optionally error-bounded compression to achieve high
compression ratios. Bit-for-bit lossless compression is also possible
through one of zfp's compression modes. zfp works best for 2D, 3D, and 4D
arrays that exhibit spatial correlation, such as continuous fields from
physics simulations, natural images, regularly sampled terrain surfaces, etc.
zfp compression of 1D arrays is possible but generally discouraged.
zfp is freely available as open source and is distributed under a BSD license.
zfp is primarily written in C and C++ but also includes Python and Fortran
bindings. zfp conforms to various language standards, including C89, C99,
C11, C++98, C++11, and C++14, and is supported on Linux, macOS, and Windows.
Quick Start
-----------
To download zfp, type:
git clone https://github.com/LLNL/zfp.git
zfp may be built using either [CMake](https://cmake.org/) or
[GNU make](https://www.gnu.org/software/make/). To use CMake, type:
cd zfp
mkdir build
cd build
cmake ..
cmake --build . --config Release
ctest
This builds the zfp library in the `build/lib` directory and the zfp
command-line executable in the `build/bin` directory. It then runs
the regression tests. The full test suite may be run by enabling the
`BUILD_TESTING_FULL` CMake option during the build step.
zfp may also be built using GNU make:
cd zfp
make
make test
Note: GNU builds are less flexible and do not support all available features,
e.g., CUDA support.
For further configuration and build instructions, please consult the
[documentation](https://zfp.readthedocs.io/en/release1.0.1/installation.html).
For examples of how to call the C library and use the C++ array classes,
see the [examples](https://zfp.readthedocs.io/en/release1.0.1/examples.html)
section.
Documentation
-------------
Full HTML [documentation](http://zfp.readthedocs.io/en/release1.0.1) is
available online.
A [PDF](http://readthedocs.org/projects/zfp/downloads/pdf/release1.0.1/)
version is also available.
Further information on the zfp software is included in these files:
- Change log: see [CHANGELOG.md](./CHANGELOG.md).
- Support and additional resources: see [SUPPORT.md](./SUPPORT.md).
- Code contributions: see [CONTRIBUTING.md](./CONTRIBUTING.md).
Authors
-------
zfp was originally developed by [Peter Lindstrom](https://people.llnl.gov/pl)
at [Lawrence Livermore National Laboratory](https://www.llnl.gov/). Please
see the [Contributors Page](https://github.com/LLNL/zfp/graphs/contributors)
for a full list of contributors.
### Citing zfp
If you use zfp for scholarly research, please cite this paper:
* Peter Lindstrom.
[Fixed-Rate Compressed Floating-Point Arrays](https://www.researchgate.net/publication/264417607_Fixed-Rate_Compressed_Floating-Point_Arrays).
IEEE Transactions on Visualization and Computer Graphics, 20(12):2674-2683, December 2014.
[doi:10.1109/TVCG.2014.2346458](http://doi.org/10.1109/TVCG.2014.2346458).
The algorithm implemented in the current version of zfp is described in the
[documentation](https://zfp.readthedocs.io/en/latest/algorithm.html) and in
the following paper:
* James Diffenderfer, Alyson Fox, Jeffrey Hittinger, Geoffrey Sanders, Peter Lindstrom.
[Error Analysis of ZFP Compression for Floating-Point Data](https://www.researchgate.net/publication/324908266_Error_Analysis_of_ZFP_Compression_for_Floating-Point_Data).
SIAM Journal on Scientific Computing, 41(3):A1867-A1898, June 2019.
[doi:10.1137/18M1168832](http://doi.org/10.1137/18M1168832).
License
-------
zfp is distributed under the terms of the BSD 3-Clause license. See
[LICENSE](./LICENSE) and [NOTICE](./NOTICE) for details.
SPDX-License-Identifier: BSD-3-Clause
LLNL-CODE-663824