Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

awesome-Auto-Parallelism

A baseline repository of Auto-Parallelism in Training Neural Networks
https://github.com/MachineLearningSystem/awesome-Auto-Parallelism

Last synced: 5 days ago
JSON representation

Pipeline Parallelism or Inter-layer Model Parallelism only:
- mlr.press
- link
- arxiv
- arxiv
- acm
Data Parallelism + Pipeline Parallelism (or Inter-layer Model Parallelism):
- mlr.press
- nips
- arxiv
- usenix
- RaNNC - scale neural networks. | DIRECT and University of Tokyo | [arxiv](http://arxiv.org/abs/2103.16063) | PyTorch | IPDPS 2021 | dynamic programming
- HeterPS
- arxiv
Data Parallelism + Intra-layer Model Parallelism (or Tensor Parallelism):
- TensorOpt - Parallelism | CUHK & Huawei | [arxiv](https://arxiv.org/pdf/2004.10856.pdf) | MindSpore | 2020 on arxiv | Dynamic Programming based graph search algorithm
- Double Recursive - 3-030-85665-6_13) | MindSpore | Euro-Par 2021 | Double Recursive
- arxiv
- arxiv
- dl.acm - Sys 2019 | same as OptCNN
- arxiv
- arxiv
Data Parallelism + Model Parallelism (or Tensor Parallelism) + Pipeline Parallelism:
- arxiv
- GSPMD
- arxiv - Karp Algorithm
- arxiv - given.
- arxiv
- arxiv - given.

Categories

Data Parallelism + Intra-layer Model Parallelism (or Tensor Parallelism): 7 Data Parallelism + Pipeline Parallelism (or Inter-layer Model Parallelism): 7 Data Parallelism + Model Parallelism (or Tensor Parallelism) + Pipeline Parallelism: 6 Pipeline Parallelism or Inter-layer Model Parallelism only: 5

Sub Categories