CUDA
CUDA® is a parallel computing platform and programming model developed by NVIDIA for general computing on graphical processing units (GPUs). With CUDA, developers are able to dramatically speed up computing applications by harnessing the power of GPUs.
- GitHub: https://github.com/topics/cuda
- Wikipedia: https://en.wikipedia.org/wiki/CUDA
- Created by: Nvidia
- Released: June 23, 2007
- Related Topics: nvcc,
- Last updated: 2026-11-15 00:08:13 UTC
- JSON Representation
https://github.com/debpalash/voicestudio
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
ai audiobook cuda dubbing elevenlabs-alternative huggingface local-first mlx omnivoice-studio speech-to-text text-to-speech transcription translate tts voice-ai voice-cloning voice-generation voicestudio workflow
Last synced: 14 Nov 2026
https://github.com/vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
amd blackwell cuda deepseek deepseek-v3 gpt gpt-oss inference kimi llama llm llm-serving model-serving moe openai pytorch qwen qwen3 tpu transformer
Last synced: 14 Nov 2026
https://github.com/jamiepine/voicebox
The open-source AI voice studio. Clone, dictate, create.
ai cuda mlx qwen3-tts qwen3-tts-ui voice-ai voice-clone whisper
Last synced: 14 Nov 2026
https://github.com/sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
attention blackwell cuda deepseek diffusion glm gpt-oss inference llama llm minimax moe qwen qwen-image reinforcement-learning transformer vlm wan
Last synced: 14 Nov 2026
https://github.com/bendlang/bend
Bend 2: a fast language that blocks AI mistakes via proof. Install: curl -fsSL https://bend-lang.com/install.sh | sh
bend cuda dependent-types gpu metal parallel programming-language proof theorem-proving
Last synced: 18 Oct 2026
https://github.com/nvidia/nvidia-docker
Build and run Docker containers leveraging NVIDIA GPUs
Last synced: 18 Oct 2026
https://github.com/nvlabs/instant-ngp
Instant neural graphics primitives: lightning fast NeRF and more
3d-reconstruction computer-graphics computer-vision cuda function-approximation machine-learning nerf neural-network real-time real-time-rendering realtime signed-distance-functions
Last synced: 14 Nov 2026
https://github.com/NVIDIA/nvidia-docker
Build and run Docker containers leveraging NVIDIA GPUs
Last synced: 14 Mar 2025
https://github.com/NVlabs/instant-ngp
Instant neural graphics primitives: lightning fast NeRF and more
3d-reconstruction computer-graphics computer-vision cuda function-approximation machine-learning nerf neural-network real-time real-time-rendering realtime signed-distance-functions
Last synced: 24 Mar 2025
https://nvlabs.github.io/instant-ngp/
Instant neural graphics primitives: lightning fast NeRF and more
3d-reconstruction computer-graphics computer-vision cuda function-approximation machine-learning nerf neural-network real-time real-time-rendering realtime signed-distance-functions
Last synced: 20 Mar 2025
https://github.com/tracel-ai/burn
Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
autodiff cross-platform cuda deep-learning kernel-fusion machine-learning metal ndarray neural-network onnx pytorch rocm rust scientific-computing tensor vulkan wasm webgpu
Last synced: 14 Nov 2026
https://github.com/kaldi-asr/kaldi
kaldi-asr/kaldi is the official location of the Kaldi project.
c-plus-plus cuda kaldi shell speaker-id speaker-verification speech speech-recognition speech-to-text
Last synced: 14 Nov 2026
https://github.com/nvidia/tensorrt-llm
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
blackwell cuda llm-serving moe pytorch
Last synced: 14 Nov 2026
https://github.com/isl-org/open3d
Open3D: A Modern Library for 3D Data Processing
3d 3d-perception arm computer-graphics cpp cuda gpu gui machine-learning mesh-processing odometry opengl pointcloud python pytorch reconstruction registration rendering tensorflow visualization
Last synced: 14 Nov 2026
https://github.com/xlite-dev/leetcuda
An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.
cuda cuda-12 cuda-cpp cuda-demo cuda-kernel cuda-kernels cuda-library cuda-toolkit flash-attention hgemm learn-cuda leet-cuda
Last synced: 18 Oct 2026
https://github.com/isl-org/Open3D
Open3D: A Modern Library for 3D Data Processing
3d 3d-perception arm computer-graphics cpp cuda gpu gui machine-learning mesh-processing odometry opengl pointcloud python pytorch reconstruction registration rendering tensorflow visualization
Last synced: 20 Mar 2025
https://github.com/nvidia/cutlass
CUDA Templates and Python DSLs for High-Performance Linear Algebra
cpp cuda deep-learning deep-learning-library gpu nvidia python
Last synced: 14 Nov 2026
https://github.com/debpalash/VoiceStudio
OmniVoice Studio is the Open-Source Elevenlabs alternative. AI Voice Clone, Dub, Dictate, Transcribe, Audiobook creator and Voice workflow studio.
ai cuda dubbing huggingface mlx omnivoice-studio transcription translate tts voice-ai voice-cloning voice-generation workflow
Last synced: 22 Aug 2026
https://github.com/nvidia/cudf
cuDF - GPU DataFrame Library
arrow cpp cuda cudf dask data-analysis data-science dataframe gpu pandas pydata python rapids
Last synced: 18 Oct 2026
https://github.com/NVIDIA/cudf
cuDF - GPU DataFrame Library
arrow cpp cuda cudf dask data-analysis data-science dataframe gpu pandas pydata python rapids
Last synced: 17 Aug 2026
https://github.com/nvidia/cuda-samples
Samples for CUDA Developers which demonstrates features in CUDA Toolkit
cuda cuda-driver-api cuda-kernels cuda-opengl
Last synced: 18 Oct 2026
https://github.com/replicate/cog
Containers for machine learning
ai containers cuda docker machine-learning pytorch tensorflow
Last synced: 14 Nov 2026
https://github.com/rapidsai/cudf
cuDF - GPU DataFrame Library
arrow cpp cuda cudf dask data-analysis data-science dataframe gpu pandas pydata python rapids
Last synced: 05 Feb 2026
https://github.com/oneflow-inc/oneflow
OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.
cuda deep-learning deep-neural-networks distributed machine-learning ml neural-network
Last synced: 14 Nov 2026
https://github.com/catboost/catboost
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
big-data catboost categorical-features coreml cuda data-mining data-science decision-trees gbdt gbm gpu gpu-computing gradient-boosting kaggle machine-learning python r tutorial
Last synced: 14 Nov 2026
https://github.com/kroma-network/tachyon
Modular ZK(Zero Knowledge) backend accelerated by GPU
blockchain c-plus-plus cpp17 cryptocurrency cryptography cuda kroma tachyon zero-knowledge zk
Last synced: 18 Oct 2026
https://github.com/hybridgroup/gocv
Go package for computer vision using OpenCV 4 and beyond. Includes support for DNN, CUDA, OpenCV Contrib, and OpenVINO.
computer-vision computervision cuda dnn face-tracking gocv golang image-processing mjpeg mjpeg-stream object-classification object-tracking onnx opencv openvino tensorflow video video-capture yolo
Last synced: 14 Nov 2026
https://github.com/Oneflow-Inc/oneflow
OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.
cuda deep-learning deep-neural-networks distributed machine-learning ml neural-network
Last synced: 20 Mar 2025
https://github.com/xuehaipan/nvitop
An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.
command-line-tool console cuda curses gpu gpu-monitoring grafana grafana-dashboard htop monitoring monitoring-tool nvidia nvidia-smi nvml process-monitoring prometheus prometheus-exporter resource-monitor top
Last synced: 18 Oct 2026
https://github.com/nvidia/warp
A Python framework for GPU-accelerated simulation, robotics, and machine learning.
cuda differentiable-programming gpu gpu-acceleration nvidia nvidia-warp python
Last synced: 18 Oct 2026
https://github.com/NVIDIA/cuda-samples
Samples for CUDA Developers which demonstrates features in CUDA Toolkit
cuda cuda-driver-api cuda-kernels cuda-opengl
Last synced: 18 Mar 2025
https://github.com/NVIDIA/cutlass
CUDA Templates for Linear Algebra Subroutines
cpp cuda deep-learning deep-learning-library gpu nvidia
Last synced: 14 Mar 2025
https://github.com/flashinfer-ai/flashinfer
FlashInfer: Kernel Library for LLM Serving
attention cuda distributed-inference gpu jit large-large-models llm-inference moe nvidia pytorch
Last synced: 14 Nov 2026
https://github.com/gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
ascend cuda deepseek distributed-inference genai high-performance-inference inference llama llm llm-inference llm-serving maas mindie openai qwen rocm sglang vllm
Last synced: 14 Nov 2026
https://github.com/chainer/chainer
A flexible framework of neural networks for deep learning
chainer cuda cudnn cupy deep-learning gpu machine-learning neural-network neural-networks numpy python
Last synced: 14 Nov 2026
https://github.com/chrxh/alien
ALIEN is a CUDA-powered artificial life simulation program.
agent-based-simulation artificial-life cuda open-ended-evolution physics-engine
Last synced: 18 Oct 2026
https://github.com/rust-gpu/rust-cuda
Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
cuda cuda-kernels cuda-programming gpgpu gpu gpu-programming rust rust-lang
Last synced: 18 Oct 2026
https://github.com/nvidia/cuml
NVIDIA cuML: GPU-Accelerated Machine Learning
cuda gpu machine-learning machine-learning-algorithms nvidia
Last synced: 14 Nov 2026
https://github.com/nvidia/nccl
Optimized primitives for collective multi-GPU communication
communications cpp cuda deep-learning gpu nvidia
Last synced: 14 Nov 2026
https://github.com/nvidiagameworks/kaolin
A PyTorch Library for Accelerating 3D Deep Learning Research
3d-deep-learning artificial-intelligence camera-api cuda differentiable-lighting differentiable-rendering gaussian-splatting interactive-visualizations neural-networks nvidia-warp physics-simulation pytorch rasterization
Last synced: 18 Oct 2026
https://github.com/nvidia/thrust
[ARCHIVED] The C++ parallel algorithms library. See https://github.com/NVIDIA/cccl
algorithms cpp cpp11 cpp14 cpp17 cpp20 cuda cxx cxx11 cxx14 cxx17 cxx20 gpu gpu-computing nvidia nvidia-hpc-sdk thrust
Last synced: 19 Oct 2026
https://github.com/thrust/thrust
[ARCHIVED] The C++ parallel algorithms library. See https://github.com/NVIDIA/cccl
algorithms cpp cpp11 cpp14 cpp17 cpp20 cuda cxx cxx11 cxx14 cxx17 cxx20 gpu gpu-computing nvidia nvidia-hpc-sdk thrust
Last synced: 17 Mar 2025
https://github.com/arrayfire/arrayfire
ArrayFire: a general purpose GPU library.
arrayfire c c-plus-plus cpp cuda gpgpu gpu hpc opencl performance scientific-computing
Last synced: 19 Oct 2026
https://github.com/NVIDIA/thrust
[ARCHIVED] The C++ parallel algorithms library. See https://github.com/NVIDIA/cccl
algorithms cpp cpp11 cpp14 cpp17 cpp20 cuda cxx cxx11 cxx14 cxx17 cxx20 gpu gpu-computing nvidia nvidia-hpc-sdk thrust
Last synced: 15 Mar 2025
https://github.com/opennmt/ctranslate2
Fast inference engine for Transformer models
avx avx2 cpp cuda deep-learning deep-neural-networks gemm inference intrinsics machine-translation mkl neon neural-machine-translation onednn openmp opennmt parallel-computing quantization thrust transformer-models
Last synced: 14 Nov 2026
https://github.com/XuehaiPan/nvitop
An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.
command-line-tool console cuda curses gpu gpu-monitoring grafana grafana-dashboard htop monitoring monitoring-tool nvidia nvidia-smi nvml process-monitoring prometheus prometheus-exporter resource-monitor top
Last synced: 20 Mar 2025
https://github.com/rapidsai/cuml
cuML - RAPIDS Machine Learning Library
cuda gpu machine-learning machine-learning-algorithms nvidia
Last synced: 14 May 2025
https://github.com/nvlabs/tiny-cuda-nn
Lightning fast C++/CUDA neural network framework
cuda deep-learning gpu mlp nerf neural-network pytorch real-time rendering
Last synced: 14 Nov 2026
https://github.com/oaid/tengine
Tengine is a lite, high performance, modular inference engine for embedded device
acl arm artificial-intelligence cnn container cuda machine-learning mips npu nvdla onnx pytorch riscv supperedge tensorflow tensorrt x86-64
Last synced: 14 Nov 2026
https://github.com/NVIDIAGameWorks/kaolin
A PyTorch Library for Accelerating 3D Deep Learning Research
3d-deep-learning artificial-intelligence camera-api cuda differentiable-lighting differentiable-rendering neural-networks pytorch rasterization
Last synced: 20 Mar 2025
https://github.com/OAID/Tengine
Tengine is a lite, high performance, modular inference engine for embedded device
acl arm artificial-intelligence cnn container cuda machine-learning mips npu nvdla onnx pytorch riscv supperedge tensorflow tensorrt x86-64
Last synced: 20 Mar 2025
https://github.com/rocm/hip
HIP: C++ Heterogeneous-Compute Interface for Portability
cuda hip hip-kernel-language hip-portability hip-runtime hipify
Last synced: 19 Oct 2026
https://github.com/deftruth/cuda-learn-notes
📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA/Tensor Cores Kernels, HGEMM, FA-2 MMA etc.🔥
cuda cuda-12 cuda-cpp cuda-demo cuda-kernel cuda-kernels cuda-library cuda-toolkit flash-attention hgemm learn-cuda leet-cuda
Last synced: 14 May 2025
https://github.com/iree-org/iree
A retargetable MLIR-based machine learning compiler and runtime toolkit.
compiler cuda jax machine-learning mlir onnx pytorch rocm runtime spirv tensorflow vulkan
Last synced: 14 Nov 2026
https://github.com/thu-ml/sageattention
[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.
attention cuda efficient-attention inference-acceleration llm llm-infra mlsys quantization triton video-generate video-generation vit
Last synced: 14 Nov 2026
https://github.com/mrnerf/lichtfeld-studio
Train, inspect, edit, automate, and export 3D Gaussian Splatting scenes from a single native application.
computer-graphics computer-vision cuda gaussian-splatting optimization
Last synced: 14 Nov 2026
https://github.com/nvidia/skills
Agent Skills for NVIDIA products — install into Claude Code, Codex, and other coding agents to run Physical AI, robotics, simulation, CUDA, and RAG workflows end to end.
agent-skills agentic-ai ai-agents claude-code codex coding-agents cuda developer-tools llm omniverse physical-ai rag robotics simulation
Last synced: 14 Nov 2026
https://github.com/Rust-GPU/Rust-CUDA
Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
cuda cuda-kernels cuda-programming gpgpu gpu gpu-programming rust rust-lang
Last synced: 27 Mar 2025
https://github.com/NVlabs/tiny-cuda-nn
Lightning fast C++/CUDA neural network framework
cuda deep-learning gpu mlp nerf neural-network pytorch real-time rendering
Last synced: 19 Mar 2025
https://github.com/ROCm/HIP
HIP: C++ Heterogeneous-Compute Interface for Portability
cuda hip hip-kernel-language hip-portability hip-runtime hipify
Last synced: 14 Mar 2025
https://github.com/ROCm-Developer-Tools/HIP
HIP: C++ Heterogeneous-Compute Interface for Portability
cuda hip hip-kernel-language hip-portability hip-runtime hipify
Last synced: 07 Mar 2025
https://github.com/NVIDIA/cuda-rust
NVIDIA's CUDA platform for Rust. Host runtime crates plus Tile (cutile-rs) and SIMT (cuda-oxide) kernel programming models in idiomatic Rust.
async compiler-backend cuda gpu heterogeneous-computing high-performance-computing nvidia programming-languages rust
Last synced: 13 Oct 2026
https://github.com/nvidia/cuda-rust
NVIDIA's CUDA platform for Rust. Host runtime crates plus Tile (cutile-rs) and SIMT (cuda-oxide) kernel programming models in idiomatic Rust.
async compiler-backend cuda gpu heterogeneous-computing high-performance-computing nvidia programming-languages rust
Last synced: 18 Oct 2026
https://github.com/nvidia/transformerengine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.
cuda deep-learning fp4 fp8 gpu jax machine-learning python pytorch
Last synced: 14 Nov 2026
https://github.com/roflcoopter/viseron
Self-hosted, local only NVR and AI Computer Vision software. With features such as object detection, motion detection, face recognition and more, it gives you the power to keep an eye on your home, office or any other place you want to monitor.
coral cuda darknet edgetpu face-recognition google-coral hacktoberfest hardware-acceleration ip-camera license-plate-recognition motion-detection network-video-capture network-video-recorder nvr object-detection rtsp surveillance tensorflow viseron yolo
Last synced: 19 Oct 2026
https://github.com/xlite-dev/cuda-learn-notes
📚Modern CUDA Learn Notes: 200+ Tensor/CUDA Cores Kernels🎉, HGEMM, FA2 via MMA and CuTe, 98~100% TFLOPS of cuBLAS/FA2.
cuda cuda-kernels cuda-programming cuda-toolkit cudnn cutlass flash-attention flash-mla gemm gemv hgemm
Last synced: 15 Apr 2025
https://github.com/OpenNMT/CTranslate2
Fast inference engine for Transformer models
avx avx2 cpp cuda deep-learning deep-neural-networks gemm inference intrinsics machine-translation mkl neon neural-machine-translation onednn openmp opennmt parallel-computing quantization thrust transformer-models
Last synced: 02 Apr 2025
https://github.com/bbuf/how-to-optim-algorithm-in-cuda
how to optimize some algorithm in cuda.
Last synced: 14 Nov 2026
https://github.com/bytedance/lightseq
LightSeq: A High Performance Library for Sequence Processing and Generation
accelerate bart beam-search bert cuda diverse-decoding gpt inference multilingual-nmt sampling training transformer
Last synced: 19 Oct 2026
https://github.com/leelachesszero/lc0
Open source neural network chess engine with GPU acceleration and broad hardware support.
alphazero alphazero-inspired chess chess-ai chess-engine cuda deep-learning deep-reinforcement-learning gpu leela-chess-zero neural-networks uci
Last synced: 14 Nov 2026
https://github.com/jittor/jittor
Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.
cuda deep-learning gpu jittor python
Last synced: 14 Nov 2026
https://github.com/google/iree
A retargetable MLIR-based machine learning compiler and runtime toolkit.
compiler cuda jax machine-learning mlir onnx pytorch runtime spirv tensorflow vulkan
Last synced: 21 Jun 2025
https://github.com/Jittor/jittor
Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.
cuda deep-learning gpu jittor python
Last synced: 20 Mar 2025
https://github.com/heavyai/heavydb
HeavyDB (formerly MapD/OmniSciDB)
cuda database gpu heavyai interactive llvm machine-learning mapd olap omnisci real-time sql visualization
Last synced: 14 Nov 2026
https://github.com/containers/ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
ai containers cuda hacktoberfest hip inference-server intel llamacpp llm podman vllm
Last synced: 14 Nov 2026
https://github.com/pytorch/ao
PyTorch native quantization for training and inference
brrr cuda dtypes float8 inference llama mx pytorch quantization sparsity training transformer
Last synced: 14 Nov 2026
https://github.com/pytorch/tensorrt
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
cuda deep-learning jetson libtorch machine-learning nvidia pytorch tensorrt
Last synced: 14 Nov 2026
https://github.com/luce-org/lucebox
LLM speculative inference server for heterogeneous hardware & consumer GPUs
cuda cuda-kernels dflash heterogeneous-computing kernel llama-cpp local-ai luce megakernel pflash poolside qwen r9700 rocm rtx3090 spark speculative-decoding speculative-prefill strix-halo
Last synced: 11 Nov 2026
https://github.com/nvidia/minkowskiengine
Minkowski Engine is an auto-diff neural network library for high-dimensional sparse tensors
3d-convolutional-network 3d-vision 4d-convolutional-neural-network auto-differentiation computer-vision convolutional-neural-networks cuda deep-learning high-dimensional-data high-dimensional-inference minkowski-engine neural-network pytorch semantic-segmentation space-time sparse-convolution sparse-tensor-network sparse-tensors spatio-temporal-analysis trilateral-filter
Last synced: 14 Nov 2026
https://github.com/xlite-dev/CUDA-Learn-Notes
📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
cuda cuda-kernels cuda-programming cuda-toolkit cudnn cutlass flash-attention flash-mla gemm gemv hgemm
Last synced: 26 Mar 2025
https://github.com/nvidia/gpu-operator
NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes
Last synced: 19 Oct 2026
https://github.com/NVIDIA/TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.
cuda deep-learning fp4 fp8 gpu jax machine-learning python pytorch
Last synced: 16 Nov 2025
https://github.com/DefTruth/CUDA-Learn-Notes
📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
cuda cuda-kernels cuda-programming cuda-toolkit cudnn cutlass flash-attention flash-mla gemm gemv hgemm
Last synced: 20 Mar 2025
https://github.com/cvcuda/cv-cuda
CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.
bytedance cloud computer-vision cpp cuda cv-cuda gpu image-processing machine-learning nvidia python
Last synced: 20 Oct 2026
https://github.com/enpeizhao/cvprojects
computer vision projects | 计算机视觉相关好玩的AI项目（Python、C++、embedded system）
computer-vision cpp cuda deep-learning embedded-systems machine-learning python tensorrt
Last synced: 20 Oct 2026
