https://github.com/HDFGroup/vol-async

Asynchronous I/O for HDF5
https://github.com/HDFGroup/vol-async

asyncio hdf5 parallel-io

Last synced: 14 days ago
JSON representation

Asynchronous I/O for HDF5

• Host: GitHub
• URL: https://github.com/HDFGroup/vol-async
• Owner: HDFGroup
• License: other
• Created: 2020-12-07T15:02:07.000Z (almost 4 years ago)
• Default Branch: develop
• Last Pushed: 2024-06-07T18:31:26.000Z (5 months ago)
• Last Synced: 2024-08-01T16:33:37.444Z (3 months ago)
• Topics: asyncio, hdf5, parallel-io
• Language: C
• Homepage: https://hdf5-vol-async.readthedocs.io
• Size: 1.27 MB
• Stars: 19
• Watchers: 11
• Forks: 13
• Open Issues: 5
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt

Awesome Lists containing this project

README

        
[![linux](https://github.com/HDFGroup/vol-async/actions/workflows/linux.yml/badge.svg?branch=develop)](https://github.com/HDFGroup/vol-async/actions/workflows/linux.yml)

# HDF5 Asynchronous I/O VOL Connector

Asynchronous I/O is becoming increasingly popular with the large amount of data access required by scientific applications. They can take advantage of an asynchronous interface by scheduling I/O as early as possible and overlap computation or communication with I/O operations, which hides the cost associated with I/O and improves the overall performance. This work is part of the [ECP-ExaIO](https://www.exascaleproject.org/research-project/exaio) project.

[](overview)

## Documentation

[**Async VOL documentation website**](https://hdf5-vol-async.readthedocs.io) has detailed build instructions and examples.

## Citation

To cite Async VOL, please use the following:

```

@ARTICLE{9459479,

  author={Tang, Houjun and Koziol, Quincey and Ravi, John and Byna, Suren},

  journal={IEEE Transactions on Parallel and Distributed Systems}, 

  title={Transparent Asynchronous Parallel I/O Using Background Threads}, 

  year={2022},

  volume={33},

  number={4},

  pages={891-902},

  doi={10.1109/TPDS.2021.3090322}}

  

@INPROCEEDINGS{8955215,

  author={Tang, Houjun and Koziol, Quincey and Byna, Suren and Mainzer, John and Li, Tonglin},

  booktitle={2019 IEEE/ACM Fourth International Parallel Data Systems Workshop (PDSW)}, 

  title={Enabling Transparent Asynchronous I/O using Background Threads}, 

  year={2019},

  volume={},

  number={},

  pages={11-19},

  doi={10.1109/PDSW49588.2019.00006}}

```