https://github.com/nmichlo/doorway

🚪 Utilities for working with files. Including easy downloading, fast hashing, stale file detection, dataset sharding, proxy downloading, file renaming

data-handling downloading file-caching hashing input-output sharding splitting

Last synced: 20 Jun 2025