Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

CUDA

CUDA® is a parallel computing platform and programming model developed by NVIDIA for general computing on graphical processing units (GPUs). With CUDA, developers are able to dramatically speed up computing applications by harnessing the power of GPUs.

https://github.com/bheisler/RustaCUDA

Rusty wrapper for the CUDA Driver API

cuda cuda-api gpu rust

Last synced: 06 Apr 2025

https://github.com/bheisler/rustacuda

Rusty wrapper for the CUDA Driver API

cuda cuda-api gpu rust

Last synced: 14 Apr 2025

https://github.com/QPT-Family/QPT

[内测中]QPT - 致力于让开源项目更好通往互联网世界的Python to EXE工具（Python打包）。

cuda deep-learning dml gpu noavx paddlepaddle pypi python qpt

Last synced: 18 Aug 2025

https://github.com/qpt-family/qpt

[内测中]QPT - 致力于让开源项目更好通往互联网世界的Python to EXE工具（Python打包）。

cuda deep-learning dml gpu noavx paddlepaddle pypi python qpt

Last synced: 12 Apr 2025

https://github.com/mp3guy/icpcuda

Super fast implementation of ICP in CUDA for compute capable devices 3.5 or higher

cuda icp

Last synced: 04 Apr 2025

https://github.com/ddemidov/vexcl

VexCL is a C++ vector expression template library for OpenCL/CUDA/OpenMP

c-plus-plus cpp11 cuda gpgpu opencl scientific-computing

Last synced: 16 May 2025

https://github.com/Devsh-Graphics-Programming/Nabla

Vulkan, OptiX and CUDA Interoperation Modular Rendering Library and Framework for PC/Linux/Android

computer-graphics cuda cuda-opengl gpgpu gpu graphics-engine graphics-library hlsl optix optix-denoiser path-tracing pathtracing pbr raytracing rendering shaders spir-v vulkan

Last synced: 10 Jun 2026

https://github.com/Xtra-Computing/thundergbm

ThunderGBM: Fast GBDTs and Random Forests on GPUs

cuda gbdt gpu machine-learning random-forest

Last synced: 12 Apr 2025

https://github.com/xtra-computing/thundergbm

ThunderGBM: Fast GBDTs and Random Forests on GPUs

cuda gbdt gpu machine-learning random-forest

Last synced: 14 Dec 2025

https://github.com/gprMax/gprMax

gprMax is open source software that simulates electromagnetic wave propagation using the Finite-Difference Time-Domain (FDTD) method for numerical modelling of Ground Penetrating Radar (GPR)

antenna cuda electromagnetic fdtd gpr gpu modelling nvidia python simulation soil

Last synced: 10 May 2025

https://github.com/thu-ml/SageAttention

Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models.

attention cuda inference-acceleration llm quantization triton video-generation

Last synced: 15 Aug 2025

https://github.com/maghoumi/pytorch-softdtw-cuda

Fast CUDA implementation of (differentiable) soft dynamic time warping for PyTorch

cuda deep-learning dynamic-time-warping pytorch soft-dtw

Last synced: 04 Apr 2025

https://github.com/cern/tigre

TIGRE: Tomographic Iterative GPU-based Reconstruction Toolbox

cuda gpus image-reconstruction matlab python tigre tomography toolbox x-ray

Last synced: 15 May 2025

https://github.com/NVIDIA/nvbench

CUDA Kernel Benchmarking Library

benchmark cuda cuda-kernels gpu kernel-benchmark nvidia performance

Last synced: 16 May 2025

https://github.com/nvidia/nvbench

CUDA Kernel Benchmarking Library

benchmark cuda cuda-kernels gpu kernel-benchmark nvidia performance

Last synced: 14 Apr 2025

https://github.com/cudamat/cudamat

Python module for performing basic dense linear algebra computations on the GPU using CUDA.

cuda linear-algebra python

Last synced: 10 Mar 2026

https://github.com/hpcaitech/fastfold

Optimizing AlphaFold Training and Inference on GPU Clusters

alphafold2 cuda evoformer gpu habana-gaudi parallelism protein-folding protein-structure pytorch

Last synced: 13 Apr 2025

https://github.com/hpcaitech/FastFold

Optimizing AlphaFold Training and Inference on GPU Clusters

alphafold2 cuda evoformer gpu habana-gaudi parallelism protein-folding protein-structure pytorch

Last synced: 01 May 2025

https://github.com/rapidsai/rmm

RAPIDS Memory Manager

cuda memory-allocation memory-management rapids

Last synced: 14 May 2025

https://github.com/BobMcDear/attorch

A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.

cuda deep-learning machine-learning openai openai-triton pytorch triton

Last synced: 23 Aug 2025

https://github.com/gprmax/gprmax

gprMax is open source software that simulates electromagnetic wave propagation using the Finite-Difference Time-Domain (FDTD) method for numerical modelling of Ground Penetrating Radar (GPR)

antenna cuda electromagnetic fdtd gpr gpu modelling nvidia python simulation soil

Last synced: 15 May 2025

https://github.com/kwea123/gaussian_splatting_notes

A detailed formulae explanation on gaussian splatting

cuda gaussian-splatting

Last synced: 05 Apr 2025

https://github.com/stochasticai/x-stable-diffusion

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6

aitemplate automl cuda docker inference notebook nvfuser onnx onnxruntime pytorch stable-diffusion tensorrt

Last synced: 04 Apr 2025

https://github.com/laugh12321/TensorRT-YOLO

🚀 你的YOLO部署神器。TensorRT Plugin、CUDA Kernel、CUDA Graphs三管齐下，享受闪电般的推理速度。| Your YOLO Deployment Powerhouse. With the synergy of TensorRT Plugins, CUDA Kernels, and CUDA Graphs, experience lightning-fast inference speeds.

cuda cuda-graph cuda-kernels cuda-programming detection onnx ppyoloe tensorrt yolov10 yolov3 yolov5 yolov6 yolov7 yolov8 yolov9

Last synced: 18 Mar 2025

https://github.com/laugh12321/tensorrt-yolo

🚀 你的YOLO部署神器。TensorRT Plugin、CUDA Kernel、CUDA Graphs三管齐下，享受闪电般的推理速度。| Your YOLO Deployment Powerhouse. With the synergy of TensorRT Plugins, CUDA Kernels, and CUDA Graphs, experience lightning-fast inference speeds.

cuda cuda-graph cuda-kernels cuda-programming detection onnx ppyoloe tensorrt yolov10 yolov3 yolov5 yolov6 yolov7 yolov8 yolov9

Last synced: 14 May 2025

https://github.com/tencent/forward

A library for high performance deep learning inference on NVIDIA GPUs.

cuda deep-learning forward gpu inference inference-engine keras neural-network onnx pytorch tensorflow tensorrt

Last synced: 05 Apr 2025

https://github.com/Tencent/Forward

A library for high performance deep learning inference on NVIDIA GPUs.

cuda deep-learning forward gpu inference inference-engine keras neural-network onnx pytorch tensorflow tensorrt

Last synced: 18 Apr 2025

https://github.com/zhihu/cubert

Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL

bert cuda deep-learning inference mkl predict tensorflow transformer

Last synced: 05 Apr 2025

https://github.com/zeux/calm

CUDA/Metal accelerated language model inference

cuda llm-inference ml

Last synced: 10 Apr 2025

https://github.com/nvidia/jitify

A single-header C++ library for simplifying the use of CUDA Runtime Compilation (NVRTC).

cpp cuda jit-compilation nvrtc runtime-compilation single-header

Last synced: 15 May 2025

https://github.com/luisagroup/luisarender

High-Performance Cross-Platform Monte Carlo Renderer Based on LuisaCompute

cpp cuda gpu high-performance ispc metal optix path-tracing ray-tracing renderer rendering siggraph-asia-2022

Last synced: 12 Apr 2025

https://github.com/openhackathons-org/gpubootcamp

This repository consists for gpu bootcamp material for HPC and AI

ai4hpc cuda data-science deep-learning deepstream gpu hpc machine-learning mpi openacc openmp rapidsai

Last synced: 27 Mar 2025

https://github.com/zhihu/cuBERT

Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL

bert cuda deep-learning inference mkl predict tensorflow transformer

Last synced: 02 Apr 2025

https://github.com/huggingface/llm_training_handbook

An open collection of methodologies to help with successful training of large language models.

cuda large-language-models llm nccl nlp performance python pytorch scalability troubleshooting

Last synced: 14 Oct 2025

https://github.com/gridhead/nvidia-auto-installer-for-fedora-linux

A CLI tool which lets you install proprietary NVIDIA drivers and much more easily on Fedora Linux (32 or above and Rawhide)

cuda fedora hacktoberfest nvidia optimus rpmfusion

Last synced: 15 May 2025

https://github.com/Kaixhin/dockerfiles

Compilation of Dockerfiles with automated builds enabled on the Docker Registry

cuda deep-learning docker dockerfiles machine-learning vnc

Last synced: 20 Mar 2025

https://github.com/radarsimx/radarsimpy

Radar Simulator built with Python and C++

cuda radar raytracing simulation

Last synced: 04 Apr 2026

https://github.com/ashvardanian/less_slow.cpp

Learning how to write "Less Slow" code in C++ 20, C 99, CUDA, PTX, & Assembly, from numerics & SIMD to coroutines, ranges, exception handling, networking and user-space IO

assembly assembly-language avx512 benchmark coroutines cpp cpp-programming cpp17 cpp20 cuda gcc google-benchmark hpc io-uring linux-kernel llvm ptx ranges tutorial tutorials

Last synced: 08 Apr 2025

https://github.com/gorgonia/cu

package cu provides an idiomatic interface to the CUDA Driver API.

cuda cuda-driver-api go golang

Last synced: 04 Apr 2025

https://github.com/shi-labs/natten

Neighborhood Attention Extension. Bringing attention to a neighborhood near you!

cuda neighborhood-attention pytorch

Last synced: 08 Feb 2026

https://github.com/salesforce/warp-drive

Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning Framework on a GPU (JMLR 2022)

cuda deep-learning gpu high-throughput multiagent-reinforcement-learning numba pytorch reinforcement-learning

Last synced: 16 May 2025

https://github.com/huggingface/large_language_model_training_playbook

An open collection of implementation tips, tricks and resources for training large language models

cuda large-language-models llm nccl nlp performance python pytorch scalability troubleshooting

Last synced: 14 Oct 2025

https://github.com/ccsb-scripps/AutoDock-GPU

AutoDock for GPUs and other accelerators

autodock4 cuda gpu-computing molecular-docking multicore-cpu opencl

Last synced: 21 Nov 2025

https://github.com/nvidia/cuquantum

Home for cuQuantum Python & NVIDIA cuQuantum SDK C++ samples

cuda cuquantum custatevec cutensornet nvidia quantum-computing

Last synced: 01 May 2026

https://github.com/cryinkfly/solidworks-for-linux

This is a project, where I give you a way to use SOLIDWORKS on Linux!

archlinux cuda fedora international linux linuxmint manjaro nvidia opengl opensuse ubuntu wine

Last synced: 15 May 2025

https://github.com/cloudcores/cuassembler

An unofficial cuda assembler, for all generations of SASS, hopefully ：）

assembler cuda nvidia sass

Last synced: 05 Apr 2025

https://zielon.github.io/insta/

INSTA - Instant Volumetric Head Avatars [CVPR2023]

3dmm avatars cuda flame instant-ngp nerf neural-network volumetric-rendering

Last synced: 26 Mar 2025

https://github.com/megviirobot/megba

MegBA: A GPU-Based Distributed Library for Large-Scale Bundle Adjustment

bundleadjustment cuda distributed gpu-acceleration graph-optimization high-performance

Last synced: 24 Jun 2025

https://github.com/cloudcores/CuAssembler

An unofficial cuda assembler, for all generations of SASS, hopefully ：）

assembler cuda nvidia sass

Last synced: 20 Mar 2025

https://github.com/mumax/3

GPU-accelerated micromagnetic simulator

cuda finite-difference-time-domain go micromagnetics scientific-computing

Last synced: 23 Jun 2025

https://github.com/ccsb-scripps/autodock-gpu

AutoDock for GPUs and other accelerators

autodock4 cuda gpu-computing molecular-docking multicore-cpu opencl

Last synced: 15 May 2025

https://github.com/cnstark/pytorch-docker

Pure Pytorch Docker Images.

centos cuda deep-learning docker nvidia pytorch ubuntu

Last synced: 06 Oct 2025

https://github.com/termoshtt/accel

(Mirror of GitLab) GPGPU Framework for Rust

cuda gpgpu rust-lang

Last synced: 10 Jan 2026

https://github.com/petercunha/pine

:evergreen_tree: Aimbot powered by real-time object detection with neural networks, GPU accelerated with Nvidia. Optimized for use with CS:GO.

aimbot csgo cuda darknet detection fortnite fps game-hacking hacking neural-network neural-networks nvidia object-detection opencl opencv overwatch pine python yolo yolov3

Last synced: 17 Mar 2026

https://github.com/petercunha/Pine

:evergreen_tree: Aimbot powered by real-time object detection with neural networks, GPU accelerated with Nvidia. Optimized for use with CS:GO.

aimbot csgo cuda darknet detection fortnite fps game-hacking hacking neural-network neural-networks nvidia object-detection opencl opencv overwatch pine python yolo yolov3

Last synced: 17 Apr 2025

https://github.com/MegviiRobot/MegBA

MegBA: A GPU-Based Distributed Library for Large-Scale Bundle Adjustment

bundleadjustment cuda distributed gpu-acceleration graph-optimization high-performance

Last synced: 07 May 2025

https://github.com/patwie/tensorflow-cmake

TensorFlow examples in C, C++, Go and Python without bazel but with cmake and FindTensorFlow.cmake

c cmake cpp cuda deep-learning golang inference opencv tensorflow tensorflow-cc tensorflow-cmake tensorflow-examples tensorflow-gpu

Last synced: 06 Apr 2025

https://github.com/vectorch-ai/ScaleLLM

A high-performance inference system for large language models, designed for production environments.

cuda efficiency gpu inference llama llama3 llm llm-inference model performance production serving speculative transformer

Last synced: 09 May 2025

https://github.com/tlkh/ai-lab

All-in-one AI container for rapid prototyping

cuda data-science deep-learning docker jupyter nvidia pytorch tensorflow

Last synced: 05 Apr 2025

https://github.com/ibm/aihwkit

IBM Analog Hardware Acceleration Kit

ai analog-devices cuda neural-networks pytorch

Last synced: 08 Oct 2025

https://github.com/DerryHub/BEVFormer_tensorrt

BEVFormer inference on TensorRT, including INT8 Quantization and Custom TensorRT Plugins (float/half/half2/int8).

bevformer cuda int8-inference pytorch quantization tensorrt-plugins

Last synced: 20 Mar 2025

https://github.com/toverainc/willow-inference-server

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

cuda deep-learning llama llm privacy speech-recognition speech-to-text text-to-speech vicuna webrtc whisper willow

Last synced: 05 Apr 2025

https://github.com/vectorch-ai/scalellm

A high-performance inference system for large language models, designed for production environments.

cuda efficiency gpu inference llama llama3 llm llm-inference model performance production serving speculative transformer

Last synced: 14 Apr 2025

https://github.com/lambdalabsml/distributed-training-guide

Best practices & guides on how to write distributed pytorch training code

cluster cuda deepspeed distributed-training fsdp gpu gpu-cluster kuberentes lambdalabs mpi nccl pytorch sharding slurm

Last synced: 16 May 2025

https://github.com/arrayfire/arrayfire-python

Python bindings for ArrayFire: A general purpose GPU library.

arrayfire cuda gpgpu gpu hpc opencl python python-bindings

Last synced: 02 Apr 2025

https://github.com/libocca/occa

Portable and vendor neutral framework for parallel programming on heterogeneous platforms.

c cpp cuda dpcpp fortran gpgpu gpu hip hpc jit metal multithreading oneapi opencl openmp sycl

Last synced: 04 Apr 2025

https://github.com/uncomplicate/deep-diamond

A fast Clojure Tensor & Deep Learning library

clojure cuda deep-learning deep-neural-networks dnnl gpu java nvidia

Last synced: 12 Apr 2025

https://github.com/alicevision/popsift

PopSift is an implementation of the SIFT algorithm in CUDA.

computer-vision cuda feature-extraction gpu image-processing sift

Last synced: 05 Apr 2025

https://github.com/ingonyama-zk/icicle

A hardware acceleration library for compute intensive cryptography :ice_cube:

cpu cryptography cuda golang msm ntt rust zero-knowledge

Last synced: 14 May 2025

https://github.com/xmrig/xmrig-cuda

NVIDIA CUDA plugin for XMRig miner

cryptonight cuda randomx xmrig

Last synced: 15 May 2025

CUDA Awesome Lists
awesome-yolo-object-detection 1,704 awesome-llm-and-aigc 1,402 awesome-cuda-and-hpc 619 gpu-guide 961 CUDA-Guide 152 Awesome-LLM4Kernel 76 awesome-dotnet-machine-learning 134 awesome-rust-list 747 awesome-mojo-max-mlir 181 PyTorch-Guide 616 awesome-julia-list 42 awesome-dl-development 91
CUDA Categories
Blogs 23,952 Object Detection Applications 523 Summary 513 Uncategorized 299 Other Versions of YOLO 250 Lighter and Deployment Frameworks 235 Frameworks 189 Interview 187 Applications 154 Machine Learning 119 Learning Resources 88 C/C++ Learning Resources 85 GUI 83 Jobs and Interview 78 Python Frameworks and Tools 77 Web3 and ZKP Framework 68 Anti-UAV Datasets 63 C/C++ Tools and Frameworks 60 Scientific Computation 55 3D Graphics and Design Tools 43