https://github.com/HMUNACHI/CUDATutorials
Zero to Hero GPU and CUDA for Maths & ML tutorials with examples.
https://github.com/HMUNACHI/CUDATutorials
cuda cuda-kernels cuda-programming machine-learning maths
Last synced: 5 days ago
JSON representation
Zero to Hero GPU and CUDA for Maths & ML tutorials with examples.
- Host: GitHub
- URL: https://github.com/HMUNACHI/CUDATutorials
- Owner: HMUNACHI
- License: mit
- Created: 2024-05-20T21:41:00.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2025-04-15T00:31:45.000Z (14 days ago)
- Last Synced: 2025-04-15T01:29:39.204Z (14 days ago)
- Topics: cuda, cuda-kernels, cuda-programming, machine-learning, maths
- Language: Cuda
- Homepage:
- Size: 402 KB
- Stars: 183
- Watchers: 4
- Forks: 5
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# From zero to hero CUDA for accelerated maths and machine learning.
 [](https://www.linkedin.com//company/80434055) [](https://twitter.com/hmunachii)
Author: [Henry Ndubuaku](https://www.linkedin.com/in/henry-ndubuaku-7b6350b8/)
## Table of Contents
- [Introduction](#introduction)
- [What is a GPU?](#what-is-a-gpu)
- [Overview of GPU Architecture](#overview-of-gpu-architecture)
- [Introduction to CUDA](#introduction-to-cuda)
- [The CUDA Programming Model](#the-cuda-programming-model)
- [Kernels and Thread Hierarchy](#kernels-and-thread-hierarchy)
- [Memory Hierarchy](#memory-hierarchy)
- [Writing CUDA Code: A Simple Example](#writing-cuda-code-a-simple-example)
- [Start tutorial](#start-tutorial)
---
## Introduction
GPUs were originally designed to accelerate graphics rendering but have evolved into powerful parallel processors capable of handling a wide range of computation-intensive tasks. By leveraging hundreds or thousands of cores, GPUs excel at executing many operations concurrently, making them ideal for high-performance computing, deep learning, scientific simulations, and more.
CUDA (Compute Unified Device Architecture) is NVIDIA’s parallel computing platform and programming model. It enables developers to harness the power of NVIDIA GPUs to accelerate their applications.
---
## What is a GPU?
A **GPU (Graphics Processing Unit)** is a specialized processor designed for parallel processing. Key points include:
- **Massively Parallel Architecture:** Consists of hundreds to thousands of small cores that perform simple computations concurrently.
- **Throughput-Oriented Design:** Optimized for executing many operations simultaneously rather than a few complex ones.
- **Diverse Applications:** Beyond graphics rendering, GPUs are used in scientific computing, machine learning, image processing, and real-time analytics.
---
## Overview of GPU Architecture
GPUs differ from CPUs in several essential ways:
- **Many-Core Design:** GPUs include multiple Streaming Multiprocessors (SMs), each with many smaller cores.
- **SIMT Model (Single Instruction, Multiple Threads):** Multiple threads execute the same instruction on different pieces of data simultaneously.
- **Memory Hierarchy:**
- **Global Memory:** Large capacity, accessible by all threads, but with high latency.
- **Shared Memory:** Low-latency, fast memory accessible within a block of threads.
- **Registers:** Very fast memory, private to each thread.
- **Latency Hiding:** GPUs keep cores busy by switching between threads to mask memory access latencies.
---
## Introduction to CUDA
CUDA is NVIDIA's parallel computing platform and application programming interface (API) that enables developers to use NVIDIA GPUs for general-purpose processing. Its main components are:
- **CUDA C/C++ Extensions:** Language enhancements for parallel kernel development.
- **Runtime and Driver APIs:** Manage GPU memory allocation, kernel launches, and synchronization.
- **Portability and Integration:** Although CUDA is specific to NVIDIA GPUs, its concepts have influenced parallel programming models on other platforms.
---
## The CUDA Programming Model
CUDA abstracts the GPU as a device capable of executing thousands of threads organized in a structured hierarchy.
### Kernels and Thread Hierarchy
- **Kernel:** A function defined to run on the GPU, marked with the `__global__` keyword.
- **Thread:** The smallest unit of execution. Each thread runs an instance of the kernel.
- **Block:** A group of threads that can share data through fast shared memory and synchronize their execution.
- **Grid:** A collection of thread blocks executing the same kernel.
**Diagram:**
### Memory Hierarchy
- **Global Memory:** High-capacity, accessible by all threads, but with higher latency.
- **Shared Memory:** Accessible only by threads within the same block, offering much lower latency.
- **Constant and Texture Memory:** Specialized spaces optimized for specific data access patterns.
- **Registers:** Fast, per-thread storage for frequently used variables.
---
## Writing CUDA Code: A Simple Example
Below is a minimal CUDA program written in C++:
```cpp
#include
// Kernel definition: runs on the GPU
__global__ void helloCUDA() {
// Each thread prints its thread index
printf("Hello from GPU thread %d\n", threadIdx.x);
}
int main() {
// Launch the kernel with 1 block of 10 threads
helloCUDA<<<1, 10>>>();
// Synchronize to ensure GPU execution completes before program exit
cudaDeviceSynchronize();
return 0;
}
```
# Stert tutorials
The files are numbered by progression order and thoroughy explained, simply read through to understand each concept, then compile and run any of the files using `nvcc -o output && ./output`, but be sure to have a GPU with the appropriate libraries installed.