https://github.com/jrs65/fdu

Parallel du-like tool
https://github.com/jrs65/fdu

Last synced: 23 days ago
JSON representation

Parallel du-like tool

• Host: GitHub
• URL: https://github.com/jrs65/fdu
• Owner: jrs65
• Created: 2023-06-10T00:50:36.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-07-05T20:52:54.000Z (over 1 year ago)
• Last Synced: 2024-04-18T02:12:15.666Z (9 months ago)
• Language: Python
• Size: 29.3 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# fdu

A fast parallel du type thing. This tool has two main goals:

- Fast scans on filesystems with slow `stat` calls, e.g. Lustre filesystems

- Separate the filesystem scan from the presentation of the results to allow

  cheap queries from the results of a single slow scan.

The first goal is accomplished by distributing the `stat` calls to multiple

parallel workers. This allows much quicker scans, but may make your sysadmin

unhappy by thrashing the filesystem with metadata queries. Caveat emptor.