awesome-cuda-and-hpc

🚀🚀🚀 This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.
https://github.com/coderonion/awesome-cuda-and-hpc

Last synced: 19 days ago
JSON representation

Applications

kalfazed/tensorrt_starter
emptysoal/cuda-image-preprocess - image-preprocess?style=social"/> : Speed up image preprocess with cuda when handle image or tensorrt inference. Cuda编程加速图像预处理。
laugh12321/TensorRT-YOLO - YOLO?style=social"/> : 🚀 TensorRT-YOLO: Support YOLOv3, YOLOv5, YOLOv6, YOLOv7, YOLOv8, YOLOv9, YOLOv10, PP-YOLOE using TensorRT acceleration with EfficientNMS! TensorRT-YOLO 是一个支持 YOLOv3、YOLOv5、YOLOv6、YOLOv7、YOLOv8、YOLOv9、YOLOv10、PP-YOLOE 和 PP-YOLOE+ 的推理加速项目，使用 NVIDIA TensorRT 进行优化。项目不仅集成了 EfficientNMS TensorRT 插件以增强后处理效果，还使用了 CUDA 核函数来加速前处理过程。TensorRT-YOLO 提供了 C++ 和 Python 推理的支持，旨在提供快速而优化的目标检测解决方案。
l-sf/Linfer - sf/Linfer?style=social"/> : 基于TensorRT的C++高性能推理库，Yolov10, YoloPv2，Yolov5/7/X/8，RT-DETR，单目标跟踪OSTrack、LightTrack。
Melody-Zhou/tensorRT_Pro-YOLOv8 - Zhou/tensorRT_Pro-YOLOv8?style=social"/> : This repository is based on shouxieai/tensorRT_Pro, with adjustments to support YOLOv8. 目前已支持 YOLOv8、YOLOv8-Cls、YOLOv8-Seg、YOLOv8-OBB、YOLOv8-Pose、RT-DETR、ByteTrack、YOLOv9、YOLOv10、RTMO 高性能推理！！！🚀🚀🚀
shouxieai/tensorRT_Pro
shouxieai/infer
hamdiboukamcha/yolov10-tensorrt - tensorrt?style=social"/> : YOLOv10 C++ TensorRT : Real-Time End-to-End Object Detection.
triple-Mu/YOLOv8-TensorRT - Mu/YOLOv8-TensorRT?style=social"/> : YOLOv8 using TensorRT accelerate !
FeiYull/TensorRT-Alpha - AI-IOT/torch2trt?style=social"/> : 🔥🔥🔥TensorRT for YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YOLOv6、YOLOv5、YOLONAS......🚀🚀🚀CUDA IS ALL YOU NEED.🍎🍎🍎
cyrusbehr/YOLOv8-TensorRT-CPP - TensorRT-CPP?style=social"/> : YOLOv8 TensorRT C++ Implementation. A C++ Implementation of YoloV8 using TensorRT Supports object detection, semantic segmentation, and body pose estimation.
VIDIA-AI-IOT/torch2trt - AI-IOT/torch2trt?style=social"/> : An easy to use PyTorch to TensorRT converter.
zhiqwang/yolort
Linaom1214/TensorRT-For-YOLO-Series - For-YOLO-Series?style=social"/> : YOLO Series TensorRT Python/C++. tensorrt for yolo series (YOLOv8, YOLOv7, YOLOv6....), nms plugin support.
wang-xinyu/tensorrtx - xinyu/tensorrtx?style=social"/> : TensorRTx aims to implement popular deep learning networks with tensorrt network definition APIs.
DefTruth/lite.ai.toolkit
PaddlePaddle/FastDeploy - to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
enazoe/yolo-tensorrt - tensorrt?style=social"/> : TensorRT8.Support Yolov5n,s,m,l,x .darknet -> tensorrt. Yolov4 Yolov3 use raw darknet *.weights and *.cfg fils. If the wrapper is useful to you,please Star it.
guojianyang/cv-detect-robot - detect-robot?style=social"/> : 🔥🔥🔥🔥🔥🔥Docker NVIDIA Docker2 YOLOV5 YOLOX YOLO Deepsort TensorRT ROS Deepstream Jetson Nano TX2 NX for High-performance deployment(高性能部署)。
BlueMirrors/Yolov5-TensorRT - TensorRT?style=social"/> : Yolov5 TensorRT Implementations.
lewes6369/TensorRT-Yolov3 - Yolov3?style=social"/> : TensorRT for Yolov3.
CaoWGG/TensorRT-YOLOv4 - YOLOv4?style=social"/> :tensorrt5, yolov4, yolov3,yolov3-tniy,yolov3-tniy-prn.
isarsoft/yolov4-triton-tensorrt - triton-tensorrt?style=social"/> : YOLOv4 on Triton Inference Server with TensorRT.
TrojanXu/yolov5-tensorrt - tensorrt?style=social"/> : A tensorrt implementation of yolov5.
tjuskyzhang/Scaled-YOLOv4-TensorRT - YOLOv4-TensorRT?style=social"/> : Implement yolov4-tiny-tensorrt, yolov4-csp-tensorrt, yolov4-large-tensorrt(p5, p6, p7) layer by layer using TensorRT API.
Syencil/tensorRT - 7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等可训练自己数据。
SeanAvery/yolov5-tensorrt - tensorrt?style=social"/> : YOLOv5 in TensorRT.
Monday-Leo/YOLOv7_Tensorrt - Leo/YOLOv7_Tensorrt?style=social"/> : A simple implementation of Tensorrt YOLOv7.
ibaiGorordo/ONNX-YOLOv6-Object-Detection - YOLOv6-Object-Detection?style=social"/> : Python scripts performing object detection using the YOLOv6 model in ONNX.
ibaiGorordo/ONNX-YOLOv7-Object-Detection - YOLOv7-Object-Detection?style=social"/> : Python scripts performing object detection using the YOLOv7 model in ONNX.
triple-Mu/yolov7 - Mu/yolov7?style=social"/> : End2end TensorRT YOLOv7.
hewen0901/yolov7_trt
tsutof/tiny_yolov2_onnx_cam
Monday-Leo/Yolov5_Tensorrt_Win10 - Leo/Yolov5_Tensorrt_Win10?style=social"/> : A simple implementation of tensorrt yolov5 python/c++🔥
Wulingtian/yolov5_tensorrt_int8
Wulingtian/yolov5_tensorrt_int8_tools
MadaoFY/yolov5_TensorRT_inference
ibaiGorordo/ONNX-YOLOv8-Object-Detection - YOLOv8-Object-Detection?style=social"/> : Python scripts performing object detection using the YOLOv8 model in ONNX.
we0091234/yolov8-tensorrt - tensorrt?style=social"/> : yolov8 tensorrt 加速.
cvdong/YOLO_TRT_SIM
cvdong/YOLO_TRT_PY
Psynosaur/Jetson-SecVision - SecVision?style=social"/> : Person detection for Hikvision DVR with AlarmIO ports, uses TensorRT and yolov4.
tatsuya-fukuoka/yolov7-onnx-infer - fukuoka/yolov7-onnx-infer?style=social"/> : Inference with yolov7's onnx model.
ervgan/yolov5_tensorrt_inference
AlbinZhu/easy-trt - trt?style=social"/> : TensorRT for YOLOv10 with CUDA.
dusty-nv/jetson-utils - nv/jetson-utils?style=social"/> : C++/CUDA/Python multimedia utilities for NVIDIA Jetson.
Alisah-Ozcan/GPU-FFT - Ozcan/GPU-FFT?style=social"/> : Welcome to the GPU-FFT-Optimization repository! We present cutting-edge algorithms and implementations for optimizing the Fast Fourier Transform (FFT) on Graphics Processing Units (GPUs).
owensgroup/RXMesh - accelerated triangle mesh processing. RXMesh is a surface triangle mesh data structure and programming model for processing static meshes on the GPU. RXMesh aims at provides a high-performance, generic, and compact data structure that can handle meshes regardless of their quality (e.g., non-manifold).
rapidsai/cugraphs - RAPIDS Graph Analytics Library. docs.rapids.ai/api/cugraph/stable/

Awesome List

Erkaman/Awesome-CUDA - CUDA?style=social"/> : This is a list of useful libraries and resources for CUDA development.
jslee02/awesome-gpgpu - gpgpu?style=social"/> : 😎 A curated list of awesome GPGPU (CUDA/OpenCL/Vulkan) resources.
mikeroyal/CUDA-Guide - Guide?style=social"/> : A guide covering CUDA including the applications and tools that will make you a better and more efficient CUDA developer.
rkinas/triton-resources - resources?style=social"/> : A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Awesome

awesome-cuda-and-hpc

Applications

Awesome List

Blogs