{"id":34775557,"url":"https://github.com/runsascoded/disk-tree","last_synced_at":"2025-12-25T08:16:12.037Z","repository":{"id":190453481,"uuid":"413177824","full_name":"runsascoded/disk-tree","owner":"runsascoded","description":"Examine/Visualize disk-space usage","archived":false,"fork":false,"pushed_at":"2025-05-22T03:18:37.000Z","size":1372,"stargazers_count":5,"open_issues_count":5,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-11-27T17:48:32.944Z","etag":null,"topics":["data-viz","disk-space","plotly","tree-map"],"latest_commit_sha":null,"homepage":"","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/runsascoded.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2021-10-03T19:33:15.000Z","updated_at":"2025-05-22T09:10:10.000Z","dependencies_parsed_at":"2023-08-24T18:56:08.464Z","dependency_job_id":"868d5ca9-5b70-426f-9da1-bc5c0537e3d6","html_url":"https://github.com/runsascoded/disk-tree","commit_stats":null,"previous_names":["runsascoded/disk-tree"],"tags_count":2,"template":false,"template_full_name":null,"purl":"pkg:github/runsascoded/disk-tree","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/runsascoded%2Fdisk-tree","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/runsascoded%2Fdisk-tree/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/runsascoded%2Fdisk-tree/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/runsascoded%2Fdisk-tree/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/runsascoded","download_url":"https://codeload.github.com/runsascoded/disk-tree/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/runsascoded%2Fdisk-tree/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28024469,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-12-25T02:00:05.988Z","response_time":58,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-viz","disk-space","plotly","tree-map"],"created_at":"2025-12-25T08:16:11.139Z","updated_at":"2025-12-25T08:16:12.031Z","avatar_url":"https://github.com/runsascoded.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# disk-tree\n\nDisk and cloud storage analyzer with caching, CLI, and web UI.\n\n\u003c!-- toc --\u003e\n- [Install](#install)\n- [Web UI](#web-ui)\n- [CLI](#cli)\n  - [Examples](#examples)\n- [Notes](#notes)\n  - [Caching](#caching)\n  - [Performance](#performance)\n\u003c!-- /toc --\u003e\n\n## Install\n\n```bash\npip install disk-tree\n```\n\n## Web UI\n\nStart the server and open http://localhost:5001:\n\n```bash\ndisk-tree-server\n```\n\n### Scan List\n\nView all cached scans, start new scans for local paths or S3 buckets:\n\n![Scan list](screenshots/scan-list.png)\n\n### Directory Browsing\n\nBrowse directories with size, modification time, children, and descendant counts. Multi-select with keyboard navigation, bulk delete:\n\n![Directory listing](screenshots/directory-listing.png)\n\n### Treemap Visualization\n\nInteractive treemaps for visualizing space usage:\n\n![Treemap](screenshots/treemap.png)\n\n### S3 Buckets\n\nBrowse and scan S3 buckets:\n\n![S3 buckets](screenshots/s3-buckets.png)\n\n## CLI\n\n```bash\ndisk-tree index --help\n# Usage: disk-tree index [OPTIONS] [URL]\n#\n# Options:\n#   -C, --no-cache-read    Force fresh scan (ignore cache)\n#   -g, --gc               Garbage collect old scans\n#   -s, --sudo             Run gfind with sudo\n#   -m, --measure-memory   Track peak memory usage\n#   --help                 Show this message and exit.\n\ndisk-tree scans           # List cached scans (JSON)\ndisk-tree-server          # Start the web UI server\n```\n\n### Examples\n\nScan an S3 bucket:\n```bash\ndisk-tree index s3://ctbk\n# 2333 files in 138 dirs, total size 45.1G\n#       4B  test.txt\n#    66.1K  favicon.ico\n#     3.9M  index.html\n#     5.5M  static\n#    11.2M  .dvc\n#    95.0M  tmp\n#   579.1M  stations\n#     1.2G  aggregated\n#     6.0G  normalized\n#    37.2G  csvs\n```\n\nScan a local directory:\n```bash\ndisk-tree index /Users/ryan/c/disk-tree\n# 97 files in 47 dirs, total size 1.5M\n#       0B  disk-tree/__init__.py\n#      77B  disk-tree/requirements.txt\n#     867B  disk-tree/setup.py\n#     2.3K  disk-tree/README.md\n#    23.8K  disk-tree/disk_tree\n#   291.8K  disk-tree/screenshots\n#   580.4K  disk-tree/.git\n#   628.6K  disk-tree/www\n```\n\n## Notes\n\n### Caching\n\n`disk-tree` caches scan results as Parquet files in `~/.config/disk-tree/scans/`, with metadata in `~/.config/disk-tree/disk-tree.db`. Override with `DISK_TREE_ROOT`.\n\n### Performance\n\n- **Local filesystems**: Uses `gfind -printf` for fast stat collection (handles sparse files correctly with 512-byte block sizes)\n- **S3**: Caches `aws s3 ls --recursive` output\n- **Fresher child patching**: When viewing a parent directory, newer child scans automatically patch in updated stats\n- **Depth-based predicate pushdown**: Parquet queries filter by depth for fast loading\n\n## Development\n\n```bash\n# Python\nuv sync\ndisk-tree-server\n\n# Web UI\ncd ui\npnpm install\npnpm dev  # http://localhost:5180 (proxies API to :5001)\n\n# Screenshots\ncd ui\npnpm screenshots\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frunsascoded%2Fdisk-tree","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frunsascoded%2Fdisk-tree","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frunsascoded%2Fdisk-tree/lists"}