Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jupyterlab/jupyterlab-hdf5
Open and explore HDF5 files in JupyterLab. Can handle very large (TB) sized files, and datasets of any dimensionality
https://github.com/jupyterlab/jupyterlab-hdf5
hdf5 hdf5-dataset hdf5-filebrowser high-dimensional jupyter jupyterlab jupyterlab-2 jupyterlab-extension labextension
Last synced: about 2 months ago
JSON representation
Open and explore HDF5 files in JupyterLab. Can handle very large (TB) sized files, and datasets of any dimensionality
- Host: GitHub
- URL: https://github.com/jupyterlab/jupyterlab-hdf5
- Owner: jupyterlab
- License: bsd-3-clause
- Created: 2018-10-02T18:20:20.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2023-10-11T06:47:49.000Z (9 months ago)
- Last Synced: 2024-04-13T03:33:01.219Z (3 months ago)
- Topics: hdf5, hdf5-dataset, hdf5-filebrowser, high-dimensional, jupyter, jupyterlab, jupyterlab-2, jupyterlab-extension, labextension
- Language: Jupyter Notebook
- Homepage:
- Size: 6.07 MB
- Stars: 115
- Watchers: 16
- Forks: 27
- Open Issues: 17
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Lists
- awesome-stars - jupyterlab/jupyterlab-hdf5 - Open and explore HDF5 files in JupyterLab. Can handle very large (TB) sized files, and datasets of any dimensionality (Jupyter Notebook)
- awesome-jupyter-resources - GitHub - 25% open · ⏱️ 21.02.2022): (JupyterLab扩展)
- best-of-jupyter - GitHub - 28% open · ⏱️ 11.10.2023): (JupyterLab Extensions)
README
[![PyPI version][pypi-badge]][pypi]
[![npm_version][npm-badge]][npm]
[interactive api docs][redoc]
# jupyterlab-hdf5
## Important Notice
[jupyterlab-hdf5](.) is no longer actively maintained, and will not work with JupyterLab 4 or later. [jupyterlab-h5web](https://github.com/silx-kit/jupyterlab-h5web) is the recommended replacement.
## Overview
Open and explore HDF5 files in JupyterLab. Can handle very large (TB) sized files. New in release v0.5.0, jlab-hdf5 can now open datasets of any dimensionality, from 0 to 32. Any 0D, 1D, or 2D slab of any dataset can easily be selected and displayed using numpy-style index syntax.
![hdf_preview][tutorial_animation]
Double clicking on an `.hdf5` file in the file browser will open it in a special HDF browser. You can then browse through the groups and open the datasets in the `.hdf5` file. All datasets will open read only.
For the moment, the browser context menu does not work with `.hdf5` files/groups/datasets. Only double clicking is currently supported.
Designed from the ground up to be as efficient as possible. Data will only be fetched as needed to create the visible display. This allows the extension to work with very large files (tested working up to the TB range).
## Installation
```bash
pip install jupyterlab_hdf
jupyter labextension install @jupyterlab/hdf5
```
This will install both the server extension and the labextension needed by this plugin.
You can also install the labextension via Jupyterlab's extension manager GUI. Keep in mind that if you use the lab extension GUI, you'll still need to install the `jupyterlab_hdf` server extension via `pip`.
### Compression filters
The extension supports all compression filters supported by h5py: https://docs.h5py.org/en/stable/high/dataset.html#filter-pipeline.
To enable support for additional filters such as [blosc](https://github.com/Blosc/hdf5-blosc) or [bitshuffle](https://github.com/kiyo-masui/bitshuffle), you need to install [hdf5plugin](https://pypi.org/project/hdf5plugin/) in addition to the extension:
```bash
pip install hdf5plugin
```
## Development
For a development install, clone the repository and then run the following in the repo dir:
```bash
pip install -e .[dev]
jlpm build:dev
```
To watch for/rebuild on changes to this extension's source code, run:
```bash
jlpm run build:watch
```
## What's in this extension
This extension has two main parts: an hdf5 filebrowser plugin, and an hdf5 dataset file type plugin.
### HDF5 Filebrowser
Allows you to navigate an `.hdf5` file's groups as though they were directories in a filesystem. Any `.hdf5` file on a user's system can be opened by entering its path (relative to the Jupyterlab home directory) in the box at the top of the browser.
#### Note on link resolution
HDF5 files can contain links that point to entities in the same file (soft links) or to entities in a different files (external links). By default, the extension does not resolve such links.
Link resolution must be enabled explicitly by setting the config field `HdfConfig.resolve_links` to `True`. For this, there are two possibilities:
- Set the config field when launching JupyterLab:
```
jupyter lab --HdfConfig.resolve_links=True
```
- Add the following line to [your notebook configuration file](https://jupyter-notebook.readthedocs.io/en/stable/config_overview.html#configure-nbserver)
```
c.HdfConfig.resolve_links = True
```
Note that this will only resolve valid links. Broken links (e.g. links to a non-existent entity) will still appear as links.
### HDF5 dataset file type
When you open a dataset using the hdf5 filebrowser, a document will open that displays the contents of the dataset via a grid.
[pypi-badge]: https://badge.fury.io/py/jupyterlab-hdf.svg
[pypi]: https://badge.fury.io/py/jupyterlab-hdf
[npm-badge]: https://badge.fury.io/js/%40jupyterlab%2Fhdf5.svg
[npm]: https://badge.fury.io/js/%40jupyterlab%2Fhdf5
[redoc]: https://jupyterlab.github.io/jupyterlab-hdf5/
[swagger]: https://petstore.swagger.io/?url=https://raw.githubusercontent.com/jupyterlab/jupyterlab-hdf5/master/jupyterlab_hdf/api/api.yaml
[tutorial_animation]: https://raw.githubusercontent.com/jupyterlab/jupyterlab-hdf5/master/example/tutorial_animation.gif