{"id":23278531,"url":"https://github.com/hdfgroup/hsds_examples","last_synced_at":"2025-08-21T11:31:29.743Z","repository":{"id":66041912,"uuid":"86270053","full_name":"HDFGroup/hsds_examples","owner":"HDFGroup","description":null,"archived":false,"fork":false,"pushed_at":"2024-04-23T15:40:21.000Z","size":945,"stargazers_count":8,"open_issues_count":2,"forks_count":4,"subscribers_count":7,"default_branch":"master","last_synced_at":"2025-08-12T21:11:37.525Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/HDFGroup.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-03-26T22:42:58.000Z","updated_at":"2024-04-23T15:40:25.000Z","dependencies_parsed_at":null,"dependency_job_id":"81ba5925-7bd2-40f9-9100-d4238f2cbbec","html_url":"https://github.com/HDFGroup/hsds_examples","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/HDFGroup/hsds_examples","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HDFGroup%2Fhsds_examples","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HDFGroup%2Fhsds_examples/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HDFGroup%2Fhsds_examples/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HDFGroup%2Fhsds_examples/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/HDFGroup","download_url":"https://codeload.github.com/HDFGroup/hsds_examples/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HDFGroup%2Fhsds_examples/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":271470104,"owners_count":24765315,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-21T02:00:08.990Z","response_time":74,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-12-19T22:32:10.056Z","updated_at":"2025-08-21T11:31:29.432Z","avatar_url":"https://github.com/HDFGroup.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"\n[![Open in GitHub Codespaces](https://github.com/codespaces/badge.svg)](https://codespaces.new/hdfgroup/hsds_examples)\n\n\n\n# HSDS (Highly Scalable Data Service) Example Programs\n\n## Introduction\n \nHSDS is a web service that implements a REST-based web service for HDF5 data stores.\n\nThis repository contains sample programs (mostly in Python) that demonstrate\nutilizing this service.\n\nAll of the sample programs can be run in a Web browser without installing any software. \nTo this end, this repository comes with a prebuild __[GitHub Codespaces](https://github.com/features/codespaces)__ configuration. Launch a Codespaces environment by clicking the banner __[\"Open in GitHub Codespaces\"](https://codespaces.new/SEEKCommons/WorkshopTraining)__ and start evaluating the Jupyter notebooks (by placing the cursor into a code cell and pressing `Ctrl+Enter` or `Shift+Enter`). When prompted for a Python kernel, select\n```\nPython 3.10.13 ~/python/current/bin/python3\n```\n\nAlternatively, you can connect to the codespace environment using VS Code.  From VS Code, select the\ncommand palette (Ctrl+Shift+P), and search for \"Codespaces: Create New Codespace\".\n\nIn either case, when the Codespace starts it will be running an HSDS instance and your environment will be automatically setup to connect to it.\n\n\nIt's also possible to run the examples locally on your desktop or EC2 instance.  In this case you'll need to setup an HSDS instance and configure your environment to connect to it.  See: https://github.com/HDFGroup/hsds/blob/master/README.md for instructions. \n\nThe Python examples use the h5pyd package which provides a h5py-api compatible interface to the HSDS\nREST API.  There are also examples, the explore using the REST API directly.\n \n \n## Using the HSDS CLI (Command Line Interface) Tools\n\nOnce the above setup is complete, you can use the CLI tools to interact with the service.  To get help on a particular tool, run with the --help option.\n\nThe following tools are provided:\n\n* hsconfigure -- setup credentials file\n* hsinfo -- display status of HSDS service\n* hsls -- list files in folders or contents of an HSDS domain\n* hstouch -- create new folders or domains\n* hsload -- upload a HDF5 file on your system to the server\n* hsget -- download a file from the server to your computer\n* hsdiff -- compare a HSDS domain with and HDF5 file\n* hsstat -- get detailed information about a HSDS domain\n* hsrm -- delete a domain or folder\n* hsacl -- display or modify Access Control Lists (ACLs) for a domain or folder\n\n## Using the Python SDK (h5pyd)\n\nThe Python SDK allows you to write Python programs using a package that shares the \nhigh-level API of the popular h5py package for regular HDF5 files.  See http://docs.h5py.org/en/latest/ for documentation of the API.\n\nNotable differences:\n\n* Since there's no concept of a current working directory, always provide an absolute path when opening a domain\n* There is no explicit support for Parallel HDF5 or SWMR\n* Some types are not yet supported: Object and Region references, Opaque\n* h5pyd extends the Dataset class with a query method - see the ghcn_query example for usage\n\nMany of the example programs can be run with either h5py or h5pyd.\n\n## Running the notebook examples\n\nTo execute the notebook examples (extension .ipynb), click on a cell and press the arrow (or ctrl-enter)\n\n## Additional Information\n\n### Websites\n\n* Main website: http://www.hdfgroup.org\n* h5pyd: https://github.com/HDFGroup/h5pyd\n* HSDS: https://github.com/HDFGroup/hsds\n* Mailing list: hdf-forum@lists.hdfgroup.org \u003chdf-forum@lists.hdfgroup.org\u003e\n\n### Other useful resources\n\n* RESTful HDF5 White Paper: https://www.hdfgroup.org/pubs/papers/RESTful_HDF5.pdf  \n* SciPy17 Presentation: http://s3.amazonaws.com/hdfgroup/docs/hdf_data_services_scipy2017.pdf \n* HDF5 For the Web: https://hdfgroup.org/wp/2015/04/hdf5-for-the-web-hdf-server\n* HSDS Security: https://hdfgroup.org/wp/2015/12/serve-protect-web-security-hdf5 \n\n\n## Reporting bugs (and general feedback)\n\nFor problems with samples in this repository, create a new issue here: https://github.com/HDFGroup/hsds_examples/issues. \n\nFor h5pyd-related problems, create new issues at http://github.com/HDFGroup/h5pyd/issues. \n\nFor problems with the service itself, or general questions/feedback, please use the hdf list (hdf-forum@lists.hdfgroup.org) or contact the HDF help desk: help@hdfgroup.org\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhdfgroup%2Fhsds_examples","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhdfgroup%2Fhsds_examples","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhdfgroup%2Fhsds_examples/lists"}