https://github.com/1duo/nccl-examples
NCCL Examples from Official NVIDIA NCCL Developer Guide.
https://github.com/1duo/nccl-examples
deep-learning distributed-systems nccl nvidia
Last synced: 16 days ago
JSON representation
NCCL Examples from Official NVIDIA NCCL Developer Guide.
- Host: GitHub
- URL: https://github.com/1duo/nccl-examples
- Owner: 1duo
- Created: 2018-05-29T19:48:21.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2018-05-29T21:37:42.000Z (over 7 years ago)
- Last Synced: 2025-02-09T22:31:06.854Z (9 months ago)
- Topics: deep-learning, distributed-systems, nccl, nvidia
- Language: CMake
- Size: 5.86 KB
- Stars: 15
- Watchers: 3
- Forks: 8
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## NCCL Examples
[NCCL](https://developer.nvidia.com/nccl) examples from [Official NVIDIA NCCL Developer Guide](https://docs.nvidia.com/deeplearning/sdk/pdf/NCCL-Developer-Guide.pdf) for faster benchmark and deployment.
### Requirement
- [CUDA](https://developer.nvidia.com/cuda-zone)
- MPI, e.g. [OpenMPI](https://www.open-mpi.org/)
- [NCCL](https://developer.nvidia.com/nccl)
Tested on Linux [CentOS 7.4](https://www.centos.org/) with CUDA 9.1, OpenMPI 3.10.0, and NCCL 2.1.15.
### Build
```
mkdir build
cd build
cmake ..
make
```
If [NCCL](https://developer.nvidia.com/nccl) was not installed in standard location:
```
cmake -DNCCL_LIBRARY=/opt/nccl_2.1.15-1+cuda9.1_x86_64/lib/libnccl.so
-DNCCL_INCLUDE_DIR=/opt/nccl_2.1.15-1+cuda9.1_x86_64/include/ ..
```