{"id":19872435,"url":"https://github.com/davidace/h5du","last_synced_at":"2025-10-18T16:51:03.955Z","repository":{"id":97018985,"uuid":"298838858","full_name":"DavidAce/h5du","owner":"DavidAce","description":"HDF5 Disk Usage Analyzer","archived":false,"fork":false,"pushed_at":"2022-06-18T18:03:12.000Z","size":11863,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-01-11T16:39:35.528Z","etag":null,"topics":["h5pp","hdf5"],"latest_commit_sha":null,"homepage":"","language":"C++","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/DavidAce.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2020-09-26T15:04:59.000Z","updated_at":"2021-11-24T22:24:04.000Z","dependencies_parsed_at":"2023-04-05T22:06:07.360Z","dependency_job_id":null,"html_url":"https://github.com/DavidAce/h5du","commit_stats":{"total_commits":36,"total_committers":1,"mean_commits":36.0,"dds":0.0,"last_synced_commit":"af57ec8ee2f1da5d9c7d9f4210ee08f45ec224fa"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DavidAce%2Fh5du","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DavidAce%2Fh5du/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DavidAce%2Fh5du/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DavidAce%2Fh5du/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/DavidAce","download_url":"https://codeload.github.com/DavidAce/h5du/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241298649,"owners_count":19940471,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["h5pp","hdf5"],"created_at":"2024-11-12T16:15:37.441Z","updated_at":"2025-10-18T16:50:58.902Z","avatar_url":"https://github.com/DavidAce.png","language":"C++","funding_links":[],"categories":[],"sub_categories":[],"readme":"# h5du\n\n```\n============================================== h5du ==============================================\nHDF5 Disk Usage Analyzer\n\nUsage : ./h5du [-option \u003cvalue\u003e].\n----------------------------------------------------------------------------------------------------\noption \u003cvalue\u003e default : Description\n----------------------------------------------------------------------------------------------------\n-h : Help. Shows this text.\n-A : Print Attributes\n-B \u003c1000|1024\u003e 1024 : Base for converting bytes to human-readable units (kB/KiB)\n-D : Print Datasets\n-d \u003cdepth filter\u003e -1 (inf) : Print objects in groups up to this depth\n-f \u003cfilepath\u003e : Path to file to analyze\n-H : Print human-readable units (kB/KiB, MB/MiB...)\n-K \u003csize|name\u003e size : Sort results according to key \"size\" or \"name\"\n-k \u003cfilter key\u003e : Filter links matching key\n-g \u003cgroup root\u003e . : Start analysis from group\n-n \u003cnum hits\u003e -1 (inf) : Max number of search hits\n-O \u003cdesc|asc\u003e desc : Sort results in ascending/descending order\n-p \u003cnum decimals\u003e 2 : Number of decimals used when printing human-readable units\n-T \u003cdset|attr\u003e dset : Sort results according to dataset or attribute\n-v \u003clevel\u003e 2 : Enables verbose logging at level 0 (max) to 5 (min)\n-V \u003clevel\u003e 2 : As \"-v\" but for the underlying h5pp library (very verbose)\n----------------------------------------------------------------------------------------------------\n\nExample 1 - Print the size of all groups recursively in descending order of size:\n ./h5du -f example.h5\n\nExample 2 - Print the size of all groups starting from group \"grpA/grpB\" in human-readable units:\n ./h5du -f example.h5 -g grpA/grpB -H\n\nExample 3 - Print the size of all groups and datasets recursively in ascending order of name:\n ./h5du -f example.h5 -D -K name -O asc\n\n```\n\n\n## Usage\n\n### Example 1\n\n```\n\u003e ./h5du -f ../example.h5\nType Path Dataset size Storage size Ratio Attribute size Header Size\nGroup . 21882429 12360506 1.77 32564 376840\nGroup xDMRG 21511752 11620887 1.85 16990 199856\nGroup xDMRG/state_0 16104024 8344188 1.93 9840 117128\nGroup xDMRG/state_0/finished 7970072 4099817 1.94 2922 37200\nGroup xDMRG/state_0/checkpoint/iter_last 8051688 4096915 1.97 2922 37200\nGroup xDMRG/state_0/checkpoint 8051688 4096915 1.97 2922 37240\nGroup xDMRG/state_0/finished/mps 7964352 4031629 1.98 1176 19376\nGroup xDMRG/state_0/checkpoint/iter_last/mps 8027120 4028711 1.99 1176 19376\nGroup xDMRG/state_1 5405328 3260379 1.66 6918 79928\nGroup xDMRG/state_1/checkpoint/iter_last 5348584 3114723 1.72 2922 37200\nGroup xDMRG/state_1/checkpoint 5348584 3114723 1.72 2922 37240\nGroup xDMRG/state_1/checkpoint/iter_last/mps 5338640 3046755 1.75 1176 19376\nGroup fDMRG 350624 719566 0.49 14068 162656\nGroup fDMRG/state_e_min 178048 355862 0.50 6918 79928\nGroup fDMRG/state_e_max 170176 347384 0.49 6918 79928\nGroup fDMRG/state_e_min/checkpoint 166600 220453 0.76 2922 37240\nGroup fDMRG/state_e_min/checkpoint/iter_last 166600 220453 0.76 2922 37200\nGroup fDMRG/state_e_max/checkpoint/iter_last 158072 212045 0.75 2922 37200\nGroup fDMRG/state_e_max/checkpoint 158072 212045 0.75 2922 37240\nGroup fDMRG/state_e_min/checkpoint/iter_last/mps 160336 153944 1.04 1176 19376\nGroup fDMRG/state_e_max/checkpoint/iter_last/mps 151040 145541 1.04 1176 19376\nGroup xDMRG/state_0/projection 62664 82408 0.76 2282 27440\nGroup xDMRG/state_1/projection 51256 80608 0.64 2282 27440\nGroup fDMRG/state_e_min/finished 6744 70361 0.10 2282 27440\nGroup fDMRG/state_e_max/finished 6616 70291 0.09 2282 27440\nGroup fDMRG/state_e_min/tables 4704 65048 0.07 1714 15208\nGroup fDMRG/state_e_max/tables 5488 65048 0.08 1714 15208\nGroup xDMRG/state_1/tables 5488 65048 0.08 1714 15208\nGroup xDMRG/state_0/tables 19600 65048 0.30 1714 15208\nGroup common 20028 20028 1.00 1506 13904\nGroup xDMRG/model 2400 16320 0.15 232 2760\nGroup fDMRG/model 2400 16320 0.15 232 2760\nGroup xDMRG/state_0/projection/mps 48480 14187 3.42 536 9616\nGroup xDMRG/state_1/projection/mps 41952 12616 3.33 536 9616\nGroup fDMRG/state_e_min/finished/mps 4400 3852 1.14 536 9616\nGroup fDMRG/state_e_max/finished/mps 4288 3787 1.13 536 9616\nGroup git 25 25 1.00 0 424\n```\n\n### Example 2\n```\n\u003e ./h5du -f ../example.h5 -g xDMRG/state_0 -H\nType Path Dataset size Storage size Ratio Attribute size Header Size\nGroup xDMRG/state_0 15.36 MiB 7.96 MiB 1.93 9.61 KiB 114.38 KiB\nGroup xDMRG/state_0/finished 7.60 MiB 3.91 MiB 1.94 2.85 KiB 36.33 KiB\nGroup xDMRG/state_0/checkpoint 7.68 MiB 3.91 MiB 1.97 2.85 KiB 36.37 KiB\nGroup xDMRG/state_0/checkpoint/iter_last 7.68 MiB 3.91 MiB 1.97 2.85 KiB 36.33 KiB\nGroup xDMRG/state_0/finished/mps 7.59 MiB 3.84 MiB 1.98 1.15 KiB 18.92 KiB\nGroup xDMRG/state_0/checkpoint/iter_last/mps 7.65 MiB 3.84 MiB 1.99 1.15 KiB 18.92 KiB\nGroup xDMRG/state_0/projection 61.20 KiB 80.48 KiB 0.76 2.23 KiB 26.80 KiB\nGroup xDMRG/state_0/tables 19.14 KiB 63.52 KiB 0.30 1.67 KiB 14.85 KiB\nGroup xDMRG/state_0/projection/mps 47.34 KiB 13.85 KiB 3.42 536.00 B 9.39 KiB\n```\n\n### Example 3\n```\n\u003e ./h5du -f ../example.h5 -D -K name -O asc\nType Path Dataset size Storage size Ratio Attribute size Header Size\nGroup . 21882429 12360506 1.77 32564 376840\nGroup common 20028 20028 1.00 1506 13904\nDataset algo_type 31 31 1.00 54 1016\nDataset config_file_contents 19556 19556 1.00 0 128\nDataset config_filename 27 27 1.00 0 128\nDataset finished 30 30 1.00 9 872\nDataset finished_all 1 1 1.00 0 104\nDataset hamiltonian 33 33 1.00 216 1016\nDataset iteration 31 31 1.00 72 872\nDataset model_size 32 32 1.00 72 872\nDataset model_type 32 32 1.00 108 1016\nDataset mpo_prefix 32 32 1.00 144 1016\nDataset mps_prefix 32 32 1.00 311 1016\nDataset position 30 30 1.00 72 872\nDataset state_name 32 32 1.00 88 1016\nDataset state_root 32 32 1.00 142 1016\nDataset step 26 26 1.00 72 872\nDataset storage_level 35 35 1.00 53 1016\nDataset storage_reason 36 36 1.00 93 1016\nGroup fDMRG 350624 719566 0.49 14068 162656\nGroup fDMRG/model 2400 16320 0.15 232 2760\nDataset hamiltonian 2400 16320 0.15 232 2720\nGroup fDMRG/state_e_max 170176 347384 0.49 6918 79928\nGroup fDMRG/state_e_max/checkpoint 158072 212045 0.75 2922 37240\nGroup fDMRG/state_e_max/checkpoint/iter_last 158072 212045 0.75 2922 37200\nDataset bond_dimensions 168 168 1.00 0 288\nDataset entanglement_entropies 168 168 1.00 0 296\nDataset measurements 1288 16376 0.08 382 2568\nDataset mem_usage 280 16360 0.02 44 848\nDataset profiling 2296 16072 0.14 404 5352\nDataset renyi_100 168 168 1.00 0 296\nDataset renyi_2 168 168 1.00 0 296\nDataset renyi_3 168 168 1.00 0 296\nDataset renyi_4 168 168 1.00 0 296\nDataset schmidt_midchain 368 280 1.31 32 552\nDataset status 1624 16240 0.10 884 6400\nDataset truncation_errors 168 168 1.00 0 296\n\n... and so on \n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdavidace%2Fh5du","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdavidace%2Fh5du","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdavidace%2Fh5du/lists"}