Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/HMUNACHI/cuda-repo
From zero to hero CUDA for accelerating maths and machine learning on GPU.
https://github.com/HMUNACHI/cuda-repo
cuda cuda-kernels cuda-programming machine-learning maths
Last synced: 1 day ago
JSON representation
From zero to hero CUDA for accelerating maths and machine learning on GPU.
- Host: GitHub
- URL: https://github.com/HMUNACHI/cuda-repo
- Owner: HMUNACHI
- License: mit
- Created: 2024-05-20T21:41:00.000Z (6 months ago)
- Default Branch: main
- Last Pushed: 2024-07-23T21:06:36.000Z (4 months ago)
- Last Synced: 2024-10-18T00:44:36.213Z (27 days ago)
- Topics: cuda, cuda-kernels, cuda-programming, machine-learning, maths
- Language: Cuda
- Homepage:
- Size: 401 KB
- Stars: 170
- Watchers: 4
- Forks: 5
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# From zero to hero CUDA for accelerated maths and machine learning.
 [](https://www.linkedin.com//company/80434055) [](https://twitter.com/hmunachii)
Author: [Henry Ndubuaku](https://www.linkedin.com/in/henry-ndubuaku-7b6350b8/)
## CUDA
CUDA (Compute Unified Device Architecture) is a parallel computing platform and programming model developed by NVIDIA.
It allows software developers to leverage the immense parallel processing power of NVIDIA GPUs (Graphics Processing Units)
for general-purpose computing tasks beyond their traditional role in graphics rendering.
GPUs are designed with thousands of smaller, more efficient cores optimized for handling multiple tasks simultaneously.
This makes them exceptionally well-suited for tasks that can be broken down into many independent operations,
such as scientific simulations, machine learning, video processing, and more.
CUDA enables substantial speedups compared to traditional CPU-only code for suitable applications.
GPUs can process vast amounts of data in parallel, accelerating computations that would take much longer on CPUs.
For certain types of workloads, GPUs can be more energy-efficient than CPUs, delivering higher performance per watt.
### CUDA Code Structure
Host Code (CPU): This is standard C/C++ code that runs on the CPU. It typically includes:
- Initialization of CUDA devices and contexts.
- Allocation of memory on the GPU.
- Transfer of data from CPU to GPU.
- Launching CUDA kernels (functions that execute on the GPU).
- Transfer of results back from GPU to CPU.
- Deallocation of GPU memory.
Device Code (GPU): This code, often written using the CUDA C/C++ extension, is specifically designed to run on the GPU. It defines:
- Kernels: Functions executed in parallel by many GPU threads. Each thread receives a unique thread ID that helps it determine its portion of the work.
- Thread Hierarchy: GPU threads are organized into blocks and grids, allowing for efficient execution across the GPU's architecture.
## Prelimnary Videos
### 1. High-Level Concepts
[](https://www.youtube.com/watch?v=4APkMJdiudU)
### 2. Programming Model
[](https://www.youtube.com/watch?v=cKI20rITSvo)
### 3. Parallelising a For Loop
[](https://www.youtube.com/watch?v=BSzoEXqP9aU)
### 4. Indexing Threads within Grids and Blocks
[](https://www.youtube.com/watch?v=cRY5utouJzQ)
### 5. Memory Model
[](https://www.youtube.com/watch?v=OSpy-HoR0ac)
### 6. Synchronisation
[](https://www.youtube.com/watch?v=PJCISyoGpug)
## Usage
You can compile and run any file using `nvcc -o output && ./output`, but be sure to have a GPU with the appropriate libraries installed. Starting from step 1, we progressively learn CUDA in the context of Mathematics and Machine Learning. Ideal for Researchers and Applied experts hoping to learn how to scale their algorithms on GPUS.