https://github.com/meta-pytorch/torchft

Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)

consensus diloco distributed-systems fault-tolerance fsdp hsdp localsgd ml pytorch torch training

Last synced: 05 Oct 2025