An open API service indexing awesome lists of open source software.

awesome-cuda-and-hpc

🚀🚀🚀 This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.
https://github.com/coderonion/awesome-cuda-and-hpc

Last synced: 4 days ago
JSON representation

Applications

CUDA Applications

  • emptysoal/cuda-image-preprocess - : Speed up image preprocess with cuda when handle image or tensorrt inference. Cuda编程加速图像预处理。
  • laugh12321/TensorRT-YOLO - : 🚀 TensorRT-YOLO: Support YOLOv3, YOLOv5, YOLOv6, YOLOv7, YOLOv8, YOLOv9, YOLOv10, PP-YOLOE using TensorRT acceleration with EfficientNMS! TensorRT-YOLO 是一个支持 YOLOv3、YOLOv5、YOLOv6、YOLOv7、YOLOv8、YOLOv9、YOLOv10、PP-YOLOE 和 PP-YOLOE+ 的推理加速项目,使用 NVIDIA TensorRT 进行优化。项目不仅集成了 EfficientNMS TensorRT 插件以增强后处理效果,还使用了 CUDA 核函数来加速前处理过程。TensorRT-YOLO 提供了 C++ 和 Python 推理的支持,旨在提供快速而优化的目标检测解决方案。
  • l-sf/Linfer - : 基于TensorRT的C++高性能推理库,Yolov10, YoloPv2,Yolov5/7/X/8,RT-DETR,单目标跟踪OSTrack、LightTrack。
  • Melody-Zhou/tensorRT_Pro-YOLOv8 - : This repository is based on shouxieai/tensorRT_Pro, with adjustments to support YOLOv8. 目前已支持 YOLOv8、YOLOv8-Cls、YOLOv8-Seg、YOLOv8-OBB、YOLOv8-Pose、RT-DETR、ByteTrack、YOLOv9、YOLOv10、RTMO 高性能推理!!!🚀🚀🚀
  • shouxieai/tensorRT_Pro - : C++ library based on tensorrt integration.
  • shouxieai/infer - : A new tensorrt integrate. Easy to integrate many tasks.
  • hamdiboukamcha/yolov10-tensorrt - : YOLOv10 C++ TensorRT : Real-Time End-to-End Object Detection.
  • triple-Mu/YOLOv8-TensorRT - : YOLOv8 using TensorRT accelerate !
  • FeiYull/TensorRT-Alpha - : 🔥🔥🔥TensorRT for YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YOLOv6、YOLOv5、YOLONAS......🚀🚀🚀CUDA IS ALL YOU NEED.🍎🍎🍎
  • cyrusbehr/YOLOv8-TensorRT-CPP - : YOLOv8 TensorRT C++ Implementation. A C++ Implementation of YoloV8 using TensorRT Supports object detection, semantic segmentation, and body pose estimation.
  • VIDIA-AI-IOT/torch2trt - : An easy to use PyTorch to TensorRT converter.
  • zhiqwang/yolort - : yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn. zhiqwang.com/yolort
  • Linaom1214/TensorRT-For-YOLO-Series - : YOLO Series TensorRT Python/C++. tensorrt for yolo series (YOLOv8, YOLOv7, YOLOv6....), nms plugin support.
  • wang-xinyu/tensorrtx - : TensorRTx aims to implement popular deep learning networks with tensorrt network definition APIs.
  • DefTruth/lite.ai.toolkit - : 🛠 A lite C++ toolkit of awesome AI models with ONNXRuntime, NCNN, MNN and TNN. YOLOX, YOLOP, YOLOv6, YOLOR, MODNet, YOLOX, YOLOv7, YOLOv5. MNN, NCNN, TNN, ONNXRuntime. “🛠Lite.Ai.ToolKit: 一个轻量级的C++ AI模型工具箱,用户友好(还行吧),开箱即用。已经包括 100+ 流行的开源模型。这是一个根据个人兴趣整理的C++工具箱,, 涵盖目标检测、人脸检测、人脸识别、语义分割、抠图等领域。”
  • PaddlePaddle/FastDeploy - : ⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
  • enazoe/yolo-tensorrt - : TensorRT8.Support Yolov5n,s,m,l,x .darknet -> tensorrt. Yolov4 Yolov3 use raw darknet *.weights and *.cfg fils. If the wrapper is useful to you,please Star it.
  • guojianyang/cv-detect-robot - : 🔥🔥🔥🔥🔥🔥Docker NVIDIA Docker2 YOLOV5 YOLOX YOLO Deepsort TensorRT ROS Deepstream Jetson Nano TX2 NX for High-performance deployment(高性能部署)。
  • BlueMirrors/Yolov5-TensorRT - : Yolov5 TensorRT Implementations.
  • lewes6369/TensorRT-Yolov3 - : TensorRT for Yolov3.
  • CaoWGG/TensorRT-YOLOv4 - :tensorrt5, yolov4, yolov3,yolov3-tniy,yolov3-tniy-prn.
  • isarsoft/yolov4-triton-tensorrt - : YOLOv4 on Triton Inference Server with TensorRT.
  • TrojanXu/yolov5-tensorrt - : A tensorrt implementation of yolov5.
  • tjuskyzhang/Scaled-YOLOv4-TensorRT - : Implement yolov4-tiny-tensorrt, yolov4-csp-tensorrt, yolov4-large-tensorrt(p5, p6, p7) layer by layer using TensorRT API.
  • Syencil/tensorRT - : TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据。
  • SeanAvery/yolov5-tensorrt - : YOLOv5 in TensorRT.
  • Monday-Leo/YOLOv7_Tensorrt - : A simple implementation of Tensorrt YOLOv7.
  • ibaiGorordo/ONNX-YOLOv6-Object-Detection - : Python scripts performing object detection using the YOLOv6 model in ONNX.
  • ibaiGorordo/ONNX-YOLOv7-Object-Detection - : Python scripts performing object detection using the YOLOv7 model in ONNX.
  • triple-Mu/yolov7 - : End2end TensorRT YOLOv7.
  • hewen0901/yolov7_trt - : yolov7目标检测算法的c++ tensorrt部署代码。
  • tsutof/tiny_yolov2_onnx_cam - : Tiny YOLO v2 Inference Application with NVIDIA TensorRT.
  • Monday-Leo/Yolov5_Tensorrt_Win10 - : A simple implementation of tensorrt yolov5 python/c++🔥
  • Wulingtian/yolov5_tensorrt_int8 - : TensorRT int8 量化部署 yolov5s 模型,实测3.3ms一帧!
  • Wulingtian/yolov5_tensorrt_int8_tools - : tensorrt int8 量化yolov5 onnx模型。
  • MadaoFY/yolov5_TensorRT_inference - : 记录yolov5的TensorRT量化及推理代码,经实测可运行于Jetson平台。
  • ibaiGorordo/ONNX-YOLOv8-Object-Detection - : Python scripts performing object detection using the YOLOv8 model in ONNX.
  • we0091234/yolov8-tensorrt - : yolov8 tensorrt 加速.
  • cvdong/YOLO_TRT_SIM - : 🐇 一套代码同时支持YOLO X, V5, V6, V7, V8 TRT推理 ™️ 🔝 ,前后处理均由CUDA核函数实现 CPP/CUDA🚀
  • cvdong/YOLO_TRT_PY - : 🐰 一套代码同时支持YOLOV5, V6, V7, V8 TRT推理 ™️ PYTHON ✈️
  • Psynosaur/Jetson-SecVision - : Person detection for Hikvision DVR with AlarmIO ports, uses TensorRT and yolov4.
  • tatsuya-fukuoka/yolov7-onnx-infer - : Inference with yolov7's onnx model.
  • ervgan/yolov5_tensorrt_inference - : TensorRT cpp inference for Yolov5 model. Supports yolov5 v1.0, v2.0, v3.0, v3.1, v4.0, v5.0, v6.0, v6.2, v7.0.
  • AlbinZhu/easy-trt - : TensorRT for YOLOv10 with CUDA.
  • dusty-nv/jetson-utils - : C++/CUDA/Python multimedia utilities for NVIDIA Jetson.
  • Alisah-Ozcan/GPU-FFT - : Welcome to the GPU-FFT-Optimization repository! We present cutting-edge algorithms and implementations for optimizing the Fast Fourier Transform (FFT) on Graphics Processing Units (GPUs).
  • owensgroup/RXMesh - : GPU-accelerated triangle mesh processing. RXMesh is a surface triangle mesh data structure and programming model for processing static meshes on the GPU. RXMesh aims at provides a high-performance, generic, and compact data structure that can handle meshes regardless of their quality (e.g., non-manifold).
  • rapidsai/cugraphs - : cuGraph - RAPIDS Graph Analytics Library. docs.rapids.ai/api/cugraph/stable/

Awesome List

  • Erkaman/Awesome-CUDA - : This is a list of useful libraries and resources for CUDA development.
  • jslee02/awesome-gpgpu - : 😎 A curated list of awesome GPGPU (CUDA/OpenCL/Vulkan) resources.
  • mikeroyal/CUDA-Guide - : A guide covering CUDA including the applications and tools that will make you a better and more efficient CUDA developer.
  • rkinas/triton-resources - : A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.

Blogs

CUDA and TensorRT Blogs