{"id":23278538,"url":"https://github.com/hdfgroup/hdflab_examples","last_synced_at":"2026-03-15T02:56:15.826Z","repository":{"id":65767150,"uuid":"140663524","full_name":"HDFGroup/hdflab_examples","owner":"HDFGroup","description":"Python Notebook examples for HDFLab","archived":false,"fork":false,"pushed_at":"2024-01-29T02:54:46.000Z","size":19891,"stargazers_count":6,"open_issues_count":0,"forks_count":2,"subscribers_count":6,"default_branch":"master","last_synced_at":"2025-08-12T21:11:36.082Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/HDFGroup.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-07-12T05:06:23.000Z","updated_at":"2023-02-14T18:10:48.000Z","dependencies_parsed_at":null,"dependency_job_id":"ddb598ac-9460-4eec-a9c5-0caf91250fb5","html_url":"https://github.com/HDFGroup/hdflab_examples","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/HDFGroup/hdflab_examples","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HDFGroup%2Fhdflab_examples","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HDFGroup%2Fhdflab_examples/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HDFGroup%2Fhdflab_examples/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HDFGroup%2Fhdflab_examples/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/HDFGroup","download_url":"https://codeload.github.com/HDFGroup/hdflab_examples/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HDFGroup%2Fhdflab_examples/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":271470105,"owners_count":24765315,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-21T02:00:08.990Z","response_time":74,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-12-19T22:32:11.247Z","updated_at":"2026-03-15T02:56:15.771Z","avatar_url":"https://github.com/HDFGroup.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# HDF Lab Examples\n\nHDF Lab provides a convenient environment for exploration of HDF5 data using HSDS or the HDF5 Library\n\nIt consists of the following components:\n\n* JupyterLab hosted on AWS\n* HDF Server (HSDS) - a REST-based service for HDF data\n* h5pyd - a Python client to the Kita Server REST API based on the popular h5py package\n* Many other popular Python packages for data analytics: Pandas, xarray, scipy, etc.\n* Sample data files\n* Example Python notebooks (this repository)\n\nThe diagram below outlines the different components of HDF Lab.  Each component is implemented as a pod that runs on a Kuberentes cluster.\n\n## How Does HDF Lab work?\n\nHDF Lab runs as a set of components (pods) on a Kubernetes cluster in AWS. When a user signs into HDF Lab, they are authenticated using their HDF Group credentials, then a new pod is spun up that will host their virtual computing environment. Each user pod is linked with a virtual disk drive of 10 GB that can be used to store notebooks, code, or data files. Any information you store on the drive will be available to you next time you log in.\n\nIn addition, you will have access to the HSDS service (which itself is running as a set of pods). HSDS enables high performance read/write access to content stored on AWS S3. Since your compute environment, HSDS, and S3 are all located in the same AWS Region, and share a high-speed network, you get much better performance compared with accessing cloud data from your desktop computer.\n\nOn HSDS there are example data files under “/shared/” that all HDF Lab users have access too. In addition, the folder /home/\u0026lt;username\u0026gt;/ will be available for you to host whatever data you like—up to 200 GB.\n\n\u003cimg src=\"https://www.hdfgroup.org/wp-content/uploads/2021/11/hdflab.png\"\u003e\n\n## Running the sample notebooks\n\nYou'll get the best results by running the examples within HDF Lab.  Getting access is easy - follow these steps:\n\n### Get an HDF Group account\n\nGo to \u003chttps://www.hdfgroup.org\u003e and click the \"Create Free Account\" button.\n\n### Sign up for HDF Lab\n\nGo to \u003chttps://www.hdfgroup.org/solutions/hdf-kita/sign-up-for-hdf-kita/\u003e, accept the license term and click the \nregister button.\n\n### Sign in to HDF Lab\n\nOnce your account is approved (you will be notified by email), go to \u003chttps://hdflab.hdfgroup.org\u003e to sign in and start your HDF Lab session.\n\n### Open the first notebook\n\nIn HDFLab, you'll find your disk contains this tutorial.  Click on examples/Tutorial/01.intro.ipynb to get started\n \n## Links\n\n*  Reference\n    *  [Code hsds](https://github.com/HDFGroup/hsds)\n    *  [Docs  h5py](http://docs.h5py.org/en/latest/index.html)\n    *  [Code h5pyd](https://github.com/HDFGroup/h5pyd)\n    *  [Code REST API](https://github.com/HDFGroup/hdf-rest-api)\n    *   [HDF Lab FAQ](https://portal.hdfgroup.org/display/KITA/HDF+Lab+Frequently+Asked+Questions)\n     \n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhdfgroup%2Fhdflab_examples","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhdfgroup%2Fhdflab_examples","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhdfgroup%2Fhdflab_examples/lists"}