https://github.com/the-ai-summer/pytorch-ddp
code for the ddp tutorial
https://github.com/the-ai-summer/pytorch-ddp
Last synced: 3 months ago
JSON representation
code for the ddp tutorial
- Host: GitHub
- URL: https://github.com/the-ai-summer/pytorch-ddp
- Owner: The-AI-Summer
- License: mit
- Created: 2022-04-03T12:51:49.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2022-04-09T09:51:22.000Z (over 3 years ago)
- Last Synced: 2023-03-05T13:17:36.705Z (over 2 years ago)
- Language: Python
- Size: 12.7 KB
- Stars: 20
- Watchers: 1
- Forks: 10
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# pytorch-ddp
code for the ddp tutorial
# 1 gpu
Accuracy of the network on the 10000 test images: 27 %
Total elapsed time: 69.03 seconds, Train 1 epoch 13.08 seconds
# DDP
```
python -m torch.distributed.launch --nproc_per_node=4 train_ddp.py
```
## ddp 4gpus
Accuracy of the network on the 10000 test images: 14 %
Total elapsed time: 70.23 seconds, Train 1 epoch 6.11 seconds
## ddp 2gpus
Accuracy of the network on the 10000 test images: 19 %
Total elapsed time: 97.03 seconds, Train 1 epoch 9.79 seconds
## mixed precision ddp 4gpus
Accuracy of the network on the 10000 test images: 15 %
Total elapsed time: 70.61 seconds, Train 1 epoch 6.52 seconds