Projects in Awesome Lists tagged with partial-allreduce
A curated list of projects in awesome lists tagged with partial-allreduce .
https://github.com/shigangli/eager-sgd
Eager-SGD is a decentralized asynchronous SGD. It utilizes novel partial collectives operations to accumulate the gradients across all the processes.
distributed-deep-learning gradient-averaging partial-allreduce
Last synced: 13 Aug 2025
https://github.com/shigangli/wagma-sgd
WAGMA-SGD is a decentralized asynchronous SGD based on wait-avoiding group model averaging. The synchronization is relaxed by making the collectives externally-triggerable, namely, a collective can be initiated without requiring that all the processes enter it. It partially reduces the data within non-overlapping groups of process, improving the parallel scalability.
distributed-deep-learning model-averaging partial-allreduce
Last synced: 13 Aug 2025