https://github.com/hdfgroup/tar2h5
Convert Tape ARchives to HDF5 files
https://github.com/hdfgroup/tar2h5
Last synced: 12 months ago
JSON representation
Convert Tape ARchives to HDF5 files
- Host: GitHub
- URL: https://github.com/hdfgroup/tar2h5
- Owner: HDFGroup
- Created: 2020-05-22T13:51:53.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2024-03-11T21:49:45.000Z (over 2 years ago)
- Last Synced: 2025-04-03T08:51:21.970Z (about 1 year ago)
- Language: C
- Size: 2.26 MB
- Stars: 2
- Watchers: 7
- Forks: 2
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Welcome to `tar2h5`
Convert Tape ARchives to HDF5 files
[](https://codespaces.new/HDFGroup/tar2h5)
* `archive_checker` - check how many files can be extracted from the input tar file
* `archive_checker_64k` - check if any files within input tar files larger than 64 KB
* `h5compactor` - convert input tar file into hdf5 file, all files within tar file should smaller than 64KB, using small files name as dataset names.
* `h5compactor-sha1` - convert input tar file into hdf5 file, all files within tar file should smaller than 64KB, using small files sha1 values as dataset names.
* `h5shredder` - convert input tar file into hdf5 file, no file size limitation, concatenate data and offsets into 4 seperate arrays for better randomized access
## Install dependent packages (on Ubuntu-22.04-LTS)
* __[HDF5 Library](https://github.com/HDFGroup/hdf5)__
```
sudo apt install libhdf5-dev libhdf5-openmpi-dev
```
* __[libarchive](https://www.libarchive.org/)__
```
sudo apt install libarchive13 libarchive-dev
```
* __[CMake](https://cmake.org/)__
```
sudo apt install cmake
```
* __[Open MPI](https://www.open-mpi.org/)__
```
sudo apt install libopenmpi-dev
```
* __[libssl](https://www.openssl.org/)__
```
sudo apt install libssl1.1 libssl-dev
```
## Install tar2h5 software
```bash
git clone https://github.com/HDFGroup/tar2h5.git
cd tar2h5
cmake .
make
```
## Uninstall tar2h5 software
```bash
make clean
```
## Run CTest
```bash
ctest
```
## Run tar2h5 software
```bash
./bin/archive_checker ./demo/tar2h5-demo.tar
./bin/archive_checker_64k ./demo/tar2h5-demo.tar
./bin/h5compactor ./demo/tar2h5-demo.tar
./bin/h5compactor-sha1 ./demo/tar2h5-demo.tar
./bin/h5shredder ./demo/tar2h5-demo.tar
```
## Visualization with H5Web
```
https://myhdf5.hdfgroup.org/
```
## Visualization with HDFCompass
```
https://support.hdfgroup.org/projects/compass/
```
### Output File Format
* `compactor` Output Sample
* `compactor-sha1` Output Sample
* `shredder` Output Sample
