Projects in Awesome Lists tagged with tensorrt
A curated list of projects in awesome lists tagged with tensorrt .
https://github.com/nvidia/tensorrt
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
deep-learning gpu-acceleration inference nvidia tensorrt
Last synced: 09 Sep 2025
https://github.com/NVIDIA/TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
deep-learning gpu-acceleration inference nvidia tensorrt
Last synced: 20 Mar 2025
https://github.com/megvii-basedetection/yolox
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
deep-learning megengine ncnn object-detection onnx openvino pytorch tensorrt yolo yolov3 yolox
Last synced: 12 May 2025
https://github.com/Megvii-BaseDetection/YOLOX
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
deep-learning megengine ncnn object-detection onnx openvino pytorch tensorrt yolo yolov3 yolox
Last synced: 14 Mar 2025
https://github.com/dusty-nv/jetson-inference
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
caffe computer-vision deep-learning digits embedded image-recognition inference jetson jetson-nano jetson-tx1 jetson-tx2 jetson-xavier jetson-xavier-nx machine-learning nvidia object-detection robotics segmentation tensorrt video-analytics
Last synced: 13 May 2025
https://github.com/wang-xinyu/tensorrtx
Implementation of popular deep learning networks with TensorRT network definition API
arcface crnn detr mnasnet mobilenetv2 mobilenetv3 resnet retinaface squeezenet swin-transformer tensorrt yolo11 yolov3 yolov3-spp yolov4 yolov5 yolov7 yolov8 yolov9
Last synced: 14 May 2025
https://github.com/mikel-brostrom/boxmot
BoxMOT: pluggable SOTA tracking modules for segmentation, object detection and pose estimation models
boosttrack botsort bytetrack clip deep-learning deepocsort improvedassociation machine-learning mot mots multi-object-tracking multi-object-tracking-segmentation ocsort oriented-bounding-box-tracking osnet segmentation strongsort tensorrt tracking-by-detection yolo
Last synced: 24 Dec 2025
https://github.com/nvidia-ai-iot/torch2trt
An easy to use PyTorch to TensorRT converter
classification inference jetson-nano jetson-tx2 jetson-xavier pytorch tensorrt
Last synced: 14 May 2025
https://github.com/NVIDIA-AI-IOT/torch2trt
An easy to use PyTorch to TensorRT converter
classification inference jetson-nano jetson-tx2 jetson-xavier pytorch tensorrt
Last synced: 20 Mar 2025
https://github.com/Tianxiaomo/pytorch-YOLOv4
PyTorch ,ONNX and TensorRT implementation of YOLOv4
darknet2onnx darknet2pytorch onnx pytorch pytorch-yolov4 tensorrt yolov3 yolov4 yolov4-tiny
Last synced: 26 Mar 2025
https://github.com/tianxiaomo/pytorch-yolov4
PyTorch ,ONNX and TensorRT implementation of YOLOv4
darknet2onnx darknet2pytorch onnx pytorch pytorch-yolov4 tensorrt yolov3 yolov4 yolov4-tiny
Last synced: 14 May 2025
https://github.com/tencent/tnn
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
coreml deep-learning face-detection hairsegmentaion inference mnn ncnn ocr openvino pytorch tengine tensorflow tensorrt
Last synced: 13 May 2025
https://github.com/Tencent/TNN
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
coreml deep-learning face-detection hairsegmentaion inference mnn ncnn ocr openvino pytorch tengine tensorflow tensorrt
Last synced: 20 Mar 2025
https://github.com/oaid/tengine
Tengine is a lite, high performance, modular inference engine for embedded device
acl arm artificial-intelligence cnn container cuda machine-learning mips npu nvdla onnx pytorch riscv supperedge tensorflow tensorrt x86-64
Last synced: 13 May 2025
https://github.com/OAID/Tengine
Tengine is a lite, high performance, modular inference engine for embedded device
acl arm artificial-intelligence cnn container cuda machine-learning mips npu nvdla onnx pytorch riscv supperedge tensorflow tensorrt x86-64
Last synced: 20 Mar 2025
https://github.com/xlite-dev/lite.ai.toolkit
🛠 A lite C++ AI toolkit: 100+🎉 models (Stable-Diffusion, Face-Fusion, YOLO series, Det, Seg, Matting) with MNN, ORT and TRT.
facefusion mnn mnn-model ncnn onnx onnxruntime robustvideomatting stable-diffusion tensorrt tnn yolov5 yolov6 yolov8 yolox
Last synced: 13 May 2025
https://github.com/deftruth/lite.ai.toolkit
🛠 A lite C++ toolkit of 100+ Awesome AI models, support ORT, MNN, NCNN, TNN and TensorRT. 🎉🎉
facefusion mnn mnn-model ncnn onnx onnxruntime robustvideomatting stable-diffusion tensorrt tnn yolov5 yolov6 yolov8 yolox
Last synced: 20 Mar 2025
https://github.com/DefTruth/lite.ai.toolkit
🛠 A lite C++ toolkit of 100+ Awesome AI models, support ORT, MNN, NCNN, TNN and TensorRT. 🎉🎉
facefusion mnn mnn-model ncnn onnx onnxruntime robustvideomatting stable-diffusion tensorrt tnn yolov5 yolov6 yolov8 yolox
Last synced: 20 Mar 2025
https://github.com/tinyvision/DAMO-YOLO
DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.
damo-yolo deep-learning imagenet nas object-detection onnx pytorch tensorrt yolo yolov5
Last synced: 20 Mar 2025
https://github.com/paddlepaddle/fastdeploy
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
android graphcore intel jetson kunlun object-detection onnx onnxruntime openvino picodet rockchip serving stable-diffusion tensorrt uie yolov5 yolov8
Last synced: 23 Jan 2026
https://github.com/PaddlePaddle/FastDeploy
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
android graphcore intel jetson kunlun object-detection onnx onnxruntime openvino picodet rockchip serving stable-diffusion tensorrt uie yolov5 yolov8
Last synced: 20 Mar 2025
https://github.com/lucasjinreal/yolov7_d2
🔥🔥🔥🔥 (Earlier YOLOv7 not official one) YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! 🔥🔥🔥
detection detextron2 detr face instance-segmentation object-detection onnx tensorrt transformers yolo yolov6 yolov7 yolox
Last synced: 14 May 2025
https://github.com/tinyvision/damo-yolo
DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.
damo-yolo deep-learning imagenet nas object-detection onnx pytorch tensorrt yolo yolov5
Last synced: 14 May 2025
https://github.com/nvidia/generativeaiexamples
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
gpu-acceleration large-language-models llm llm-inference microservice nemo rag retrieval-augmented-generation tensorrt triton-inference-server
Last synced: 13 May 2025
https://github.com/open-mmlab/mmdeploy
OpenMMLab Model Deployment Framework
computer-vision deep-learning deployment mmdetection mmsegmentation model-converter ncnn onnx onnxruntime openvino pplnn pytorch sdk tensorrt
Last synced: 13 May 2025
https://github.com/NVIDIA/GenerativeAIExamples
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
gpu-acceleration large-language-models llm llm-inference microservice nemo rag retrieval-augmented-generation tensorrt triton-inference-server
Last synced: 28 Mar 2025
https://github.com/pytorch/tensorrt
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
cuda deep-learning jetson libtorch machine-learning nvidia pytorch tensorrt
Last synced: 17 Jan 2026
https://github.com/shouxieai/tensorrt_pro
C++ library based on tensorrt integration
deep-learning object-detection pytorch tensorrt yolov5 yolox
Last synced: 13 Dec 2025
https://github.com/shouxieai/tensorRT_Pro
C++ library based on tensorrt integration
deep-learning object-detection pytorch tensorrt yolov5 yolox
Last synced: 20 Mar 2025
https://github.com/jolibrain/deepdetect
Deep Learning API and Server in C++14 support for PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE
caffe deep-learning gpu image-classification image-search image-segmentation machine-learning ncnn neural-nets object-detection pytorch rest-api tensorrt tensorrt-conversion tensorrt-inference time-series tsne xgboost
Last synced: 14 May 2025
https://github.com/enpeizhao/cvprojects
computer vision projects | 计算机视觉相关好玩的AI项目（Python、C++、embedded system）
computer-vision cpp cuda deep-learning embedded-systems machine-learning python tensorrt
Last synced: 14 May 2025
https://github.com/ppogg/yolov5-lite
🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~
android-app mnn mobilenet ncnn onnxruntime openvivo picodet pplcnet pytorch repvgg shufflenetv2 tensorrt tflite transformer yolov5
Last synced: 15 May 2025
https://github.com/pytorch/TensorRT
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
cuda deep-learning jetson libtorch machine-learning nvidia pytorch tensorrt
Last synced: 09 Apr 2025
https://github.com/ppogg/YOLOv5-Lite
🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~
android-app mnn mobilenet ncnn onnxruntime openvivo picodet pplcnet pytorch repvgg shufflenetv2 tensorrt tflite transformer yolov5
Last synced: 20 Mar 2025
https://github.com/hunglc007/tensorflow-yolov4-tflite
YOLOv4, YOLOv4-tiny, YOLOv3, YOLOv3-tiny Implemented in Tensorflow 2.0, Android. Convert YOLO v4 .weights tensorflow, tensorrt and tflite
android object-detection tensorflow tensorrt tf2 tflite yolov3 yolov3-tiny yolov4
Last synced: 14 May 2025
https://github.com/deepcam-cn/yolov5-face
YOLO5Face: Why Reinventing a Face Detector (https://arxiv.org/abs/2105.12931) ECCV Workshops 2022)
arcface blazeface pytorch retinaface scrfd shufflenet tensorrt tinaface yolo yolov5 yolov7
Last synced: 08 Oct 2025
https://github.com/666DZY666/micronet
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape
batch-normalization-fuse bnn convolutional-networks dorefa group-convolution integer-arithmetic-only model-compression network-in-network network-slimming neuromorphic-computing onnx post-training-quantization pruning pytorch quantization quantization-aware-training tensorrt tensorrt-int8-python twn xnor-net
Last synced: 20 Mar 2025
https://github.com/enpeizhao/CVprojects
computer vision projects | 计算机视觉相关好玩的AI项目（Python、C++、embedded system）
computer-vision cpp cuda deep-learning embedded-systems machine-learning python tensorrt
Last synced: 20 Mar 2025
https://github.com/collabora/whisperlive
A nearly-live implementation of OpenAI's Whisper.
dictation obs openai tensorrt tensorrt-llm text-to-speech translation voice-recognition whisper whisper-tensorrt
Last synced: 09 Apr 2025
https://github.com/collabora/WhisperLive
A nearly-live implementation of OpenAI's Whisper.
dictation obs openai tensorrt tensorrt-llm text-to-speech translation voice-recognition whisper whisper-tensorrt
Last synced: 07 Apr 2025
https://github.com/jkjung-avt/tensorrt_demos
TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet
googlenet jetson modnet mtcnn object-detection ssd-mobilenet tensorrt yolov3 yolov4
Last synced: 11 Apr 2025
https://github.com/roboflow/inference
Turn any computer or edge device into a command center for your computer vision projects.
agents classification computer-vision deployment docker inference inference-api inference-server instance-segmentation jetson machine-learning object-detection onnx python tensorrt vit yolo11 yolov12 yolov5 yolov8
Last synced: 07 Jan 2026
https://github.com/marcoslucianops/deepstream-yolo
NVIDIA DeepStream SDK 7.1 / 7.0 / 6.4 / 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models
cuda darknet deepstream mmyolo nvidia nvidia-deepstream-sdk object-detection paddle ppyoloe pytorch rtdetr rtmdet tensorrt ultralytics yolo
Last synced: 14 May 2025
https://github.com/dt42/berrynet
Deep learning gateway on Raspberry Pi and other edge devices
aiot deep-learning edge-ai edge-computing edge-devices iot mqtt openvino raspberry-pi tensorflow tensorrt
Last synced: 08 Oct 2025
https://github.com/marcoslucianops/DeepStream-Yolo
NVIDIA DeepStream SDK 7.1 / 7.0 / 6.4 / 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models
cuda darknet deepstream mmyolo nvidia nvidia-deepstream-sdk object-detection paddle ppyoloe pytorch rtdetr rtmdet tensorrt ultralytics yolo
Last synced: 19 Mar 2025
https://github.com/DT42/BerryNet
Deep learning gateway on Raspberry Pi and other edge devices
aiot deep-learning edge-ai edge-computing edge-devices iot mqtt openvino raspberry-pi tensorflow tensorrt
Last synced: 26 Apr 2025
https://github.com/paddlepaddle/paddleslim
PaddleSlim is an open-source library for deep model compression and architecture search.
bert compression detection distillation ernie nas pruning quantization segmentation sparsity tensorrt transformer yolov5 yolov6 yolov7
Last synced: 14 May 2025
https://github.com/PaddlePaddle/PaddleSlim
PaddleSlim is an open-source library for deep model compression and architecture search.
bert compression detection distillation ernie nas pruning quantization segmentation sparsity tensorrt transformer yolov5 yolov6 yolov7
Last synced: 20 Mar 2025
https://github.com/triple-mu/yolov8-tensorrt
YOLOv8 using TensorRT accelerate !
deepstream detection jetson onnx pose segment tensorrt yolov8
Last synced: 14 May 2025
https://github.com/triple-Mu/YOLOv8-TensorRT
YOLOv8 using TensorRT accelerate !
deepstream detection jetson onnx pose segment tensorrt yolov8
Last synced: 18 Mar 2025
https://github.com/coincheung/bisenet
Add bisenetv2. My implementation of BiSeNet
ade20k bisenet cityscapes cocostuff ncnn openvino pytorch tensorrt triton-inference-server
Last synced: 14 May 2025
https://github.com/CoinCheung/BiSeNet
Add bisenetv2. My implementation of BiSeNet
ade20k bisenet cityscapes cocostuff ncnn openvino pytorch tensorrt triton-inference-server
Last synced: 28 Mar 2025
https://github.com/feiyull/tensorrt-alpha
🔥🔥🔥TensorRT for YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YOLOv6、YOLOv5、YOLONAS......🚀🚀🚀CUDA IS ALL YOU NEED.🍎🍎🍎
cuda efficientdet libfacedetection rt-detr tensorrt u2net yolonas yolor yolov3 yolov4 yolov5 yolov6 yolov7 yolov8 yolov8-pose yolov8-seg yolox
Last synced: 08 Apr 2025
https://github.com/FeiYull/TensorRT-Alpha
🔥🔥🔥TensorRT for YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YOLOv6、YOLOv5、YOLONAS......🚀🚀🚀CUDA IS ALL YOU NEED.🍎🍎🍎
cuda efficientdet libfacedetection rt-detr tensorrt u2net yolonas yolor yolov3 yolov4 yolov5 yolov6 yolov7 yolov8 yolov8-pose yolov8-seg yolox
Last synced: 21 Apr 2025
https://github.com/tensorlayer/hyperpose
Library for Fast and Flexible Human Pose Estimation
computer-vision distributed-training mobilenet neural-networks openpose pose-estimation tensorflow tensorlayer tensorrt
Last synced: 12 Jan 2026
https://github.com/tensorlayer/HyperPose
Library for Fast and Flexible Human Pose Estimation
computer-vision distributed-training mobilenet neural-networks openpose pose-estimation tensorflow tensorlayer tensorrt
Last synced: 13 Apr 2025
https://github.com/geekalexis/fastmot
High-performance multiple object tracking based on YOLO, Deep SORT, and KLT 🚀
computer-vision deep-learning deep-sort edge-computing jetson lucas-kanade multi-object-tracking object-detection people-counter real-time reid scaledyolov4 ssd tensorrt video-analysis yolov3 yolov4
Last synced: 08 Apr 2025
https://github.com/GeekAlexis/FastMOT
High-performance multiple object tracking based on YOLO, Deep SORT, and KLT 🚀
computer-vision deep-learning deep-sort edge-computing jetson lucas-kanade multi-object-tracking object-detection people-counter real-time reid scaledyolov4 ssd tensorrt video-analysis yolov3 yolov4
Last synced: 20 Mar 2025
https://github.com/Gumpest/YOLOv5-Multibackbone-Compression
YOLOv5 Series Multi-backbone(TPH-YOLOv5, Ghostnet, ShuffleNetv2, Mobilenetv3Small, EfficientNetLite, PP-LCNet, SwinTransformer YOLO), Module(CBAM, DCN), Pruning (EagleEye, Network Slimming), Quantization (MQBench) and Deployment (TensorRT, ncnn) Compression Tool Box.
cbam eagleeye efficientnetlite-yolov5 ghostnet-yolov5 mobilenetv3small-yolov5 mqbench ncnn network-slimming pplcnet shufflenetv2-yolov5 swin-transformer tensorrt tph-yolov5
Last synced: 20 Apr 2025
https://github.com/EdVince/Stable-Diffusion-NCNN
Stable Diffusion in NCNN with c++, supported txt2img and img2img
android clip cpp diffusion executable img2img mnn ncnn onnx stable-diffusion tensorrt tnn txt2img
Last synced: 13 Apr 2025
https://github.com/ddPn08/Radiata
Stable diffusion webui based on diffusers.
stable-diffusion stable-diffusion-webui tensorrt text-to-image
Last synced: 22 Apr 2025
https://github.com/nvidia-ai-iot/trt_pose
Real-time pose estimation accelerated with NVIDIA TensorRT
human-pose human-pose-estimation jetson jetson-nano jetson-xavier live-demo pretrained-models pytorch real-time tensorrt torch2trt
Last synced: 28 Jun 2025
https://github.com/NVIDIA-AI-IOT/trt_pose
Real-time pose estimation accelerated with NVIDIA TensorRT
human-pose human-pose-estimation jetson jetson-nano jetson-xavier live-demo pretrained-models pytorch real-time tensorrt torch2trt
Last synced: 14 Mar 2025
https://github.com/babitmf/bmf
Cross-platform, customizable multimedia/video processing framework. With strong GPU acceleration, heterogeneous design, multi-language support, easy to use, multi-framework compatible and high performance, the framework is ideal for transcoding, AI inference, algorithm integration, live video streaming, and more.
ai arm bmf bytedance cpp cross-platform cuda ffmpeg gpu heterogeneous live-video mediacodec multimedia numpy nvidia opencv python tensorrt transcode x86-64
Last synced: 14 May 2025
https://github.com/NVIDIA/retinanet-examples
Fast and accurate object detection with end-to-end GPU optimization
deep-learning neural-network object-detection python pytorch retinanet tensorrt
Last synced: 19 Jul 2025
https://github.com/nvidia/retinanet-examples
Fast and accurate object detection with end-to-end GPU optimization
deep-learning neural-network object-detection python pytorch retinanet tensorrt
Last synced: 12 Apr 2025
https://github.com/voldemortX/pytorch-auto-drive
PytorchAutoDrive: Segmentation models (ERFNet, ENet, DeepLab, FCN...) and Lane detection models (SCNN, RESA, LSTR, LaneATT, BézierLaneNet...) based on PyTorch with fast training, visualization, benchmarking & deployment help
apex cityscapes culane deeplab erfnet fcn gtav lane-detection lstr mobilenet onnx pascal-voc pytorch resa scnn semantic-segmentation tensorboard tensorrt tusimple
Last synced: 20 Mar 2025
https://github.com/qengineering/jetson-nano-ubuntu-20-image
Jetson Nano with Ubuntu 20.04 image
cuda deep-learning jetson-nano opencv pytorch sd-card-image team-viewer tensorflow tensorrt torch torchvision ubuntu2004
Last synced: 15 May 2025
https://github.com/Adlik/Adlik
Adlik: Toolkit for Accelerating Deep Learning Inference
compiler deep-learning docker-images inference inference-engine model-optimizer openvino tensorflow-serving tensorrt
Last synced: 20 Nov 2025
https://github.com/BabitMF/bmf
Cross-platform, customizable multimedia/video processing framework. With strong GPU acceleration, heterogeneous design, multi-language support, easy to use, multi-framework compatible and high performance, the framework is ideal for transcoding, AI inference, algorithm integration, live video streaming, and more.
ai arm bmf bytedance cpp cross-platform cuda ffmpeg gpu heterogeneous live-video mediacodec multimedia numpy nvidia opencv python tensorrt transcode x86-64
Last synced: 11 Apr 2025
https://github.com/zerollzeng/tiny-tensorrt
Deploy your model with TensorRT quickly.
Last synced: 20 Mar 2025
https://github.com/zhiqwang/yolort
yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
deployment detection graghsurgeon inference jit libtorch lightning ncnn nms onnx onnxruntime pytorch tensorrt torchscript trt tvm visualization yolo yolort yolov5
Last synced: 15 May 2025
https://github.com/nvidia-ai-iot/nanosam
A distilled Segment Anything (SAM) model capable of running real-time with NVIDIA TensorRT
jetson-orin jetson-orin-nano nvidia real-time segment-anything tensorrt
Last synced: 28 Jun 2025
https://github.com/nvidia-ai-iot/tf_trt_models
TensorFlow models accelerated with NVIDIA TensorRT
image-classification inference jetson models neural-network nvidia object-detection optimize realtime tensorflow tensorrt train tx1 tx2
Last synced: 28 Jun 2025
https://github.com/deepvac/deepvac
PyTorch Project Specification.
amp coreml ddp deepvac ncnn onnx python pytorch quantization tensorboard tensorrt torchscript
Last synced: 16 May 2025
https://github.com/Bobo-y/flexible-yolov5
More readable and flexible yolov5 with more backbone(gcn, resnet, shufflenet, moblienet, efficientnet, hrnet, swin-transformer, etc) and (cbam，dcn and so on), and tensorrt
backbone cbam dcnv2 gcn hrnet moblienet neck object-detection ptq pytorch qat resnet shufflenet sparsity swin-transformer tensorrt triton-server yolov3 yolov5
Last synced: 20 Apr 2025
https://github.com/DeepVAC/deepvac
PyTorch Project Specification.
amp coreml ddp deepvac ncnn onnx python pytorch quantization tensorboard tensorrt torchscript
Last synced: 20 Mar 2025
https://github.com/insight-platform/Savant
Python Computer Vision & Video Analytics Framework With Batteries Included
computer-vision cuda deep-learning deepstream edge-computing inference-engine instance-segmentation machine-learning nvidia nvidia-deepstream-sdk object-detection opencv peoplenet tensorrt video yolo yolov5-face yolov8 yolov8-face
Last synced: 21 Apr 2025
https://github.com/pythonlessons/TensorFlow-2.x-YOLOv3
YOLOv3 implementation in TensorFlow 2.3.1
darknet detection pretrained-weights tensorflow2 tensorrt tracking yolo yolov3 yolov4 yolov4-training
Last synced: 20 Apr 2025
https://github.com/pythonlessons/tensorflow-2.x-yolov3
YOLOv3 implementation in TensorFlow 2.3.1
darknet detection pretrained-weights tensorflow2 tensorrt tracking yolo yolov3 yolov4 yolov4-training
Last synced: 18 Oct 2025
https://github.com/theAIGuysCode/yolov4-custom-functions
A Wide Range of Custom Functions for YOLOv4, YOLOv4-tiny, YOLOv3, and YOLOv3-tiny Implemented in TensorFlow, TFLite, and TensorRT.
custom-yolov4 object-detection tensorflow tensorrt tf2 tflite yolov3 yolov4 yolov4-tiny
Last synced: 20 Apr 2025
https://github.com/NVIDIA-AI-IOT/nanosam
A distilled Segment Anything (SAM) model capable of running real-time with NVIDIA TensorRT
jetson-orin jetson-orin-nano nvidia real-time segment-anything tensorrt
Last synced: 20 Mar 2025
https://github.com/grimoire/mmdetection-to-tensorrt
convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.
cascade-rcnn faster-rcnn inference mmdetection object-detection retinanet ssd tensorrt yolov3
Last synced: 04 Apr 2025
https://github.com/nndeploy/nndeploy
nndeploy是一款模型端到端部署框架。以多端推理以及基于有向无环图模型部署为基础，致力为用户提供跨平台、简单易用、高性能的模型部署体验。
ascend easy-to-use hpc mnn model-deployment multi-inference openvino out-of-box-model parallel rknn tensorrt yolo
Last synced: 14 Dec 2025
https://github.com/stochasticai/x-stable-diffusion
Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6
aitemplate automl cuda docker inference notebook nvfuser onnx onnxruntime pytorch stable-diffusion tensorrt
Last synced: 04 Apr 2025
https://github.com/jdai-cv/centerx
This repo is implemented based on detectron2 and centernet
caffe centernet centerx deep-learning detectron2 fast-reid object-detection onnx tensorrt
Last synced: 05 Apr 2025
https://github.com/laugh12321/TensorRT-YOLO
🚀 你的YOLO部署神器。TensorRT Plugin、CUDA Kernel、CUDA Graphs三管齐下，享受闪电般的推理速度。| Your YOLO Deployment Powerhouse. With the synergy of TensorRT Plugins, CUDA Kernels, and CUDA Graphs, experience lightning-fast inference speeds.
cuda cuda-graph cuda-kernels cuda-programming detection onnx ppyoloe tensorrt yolov10 yolov3 yolov5 yolov6 yolov7 yolov8 yolov9
Last synced: 18 Mar 2025
https://github.com/JDAI-CV/centerX
This repo is implemented based on detectron2 and centernet
caffe centernet centerx deep-learning detectron2 fast-reid object-detection onnx tensorrt
Last synced: 19 Jul 2025
https://github.com/laugh12321/tensorrt-yolo
🚀 你的YOLO部署神器。TensorRT Plugin、CUDA Kernel、CUDA Graphs三管齐下，享受闪电般的推理速度。| Your YOLO Deployment Powerhouse. With the synergy of TensorRT Plugins, CUDA Kernels, and CUDA Graphs, experience lightning-fast inference speeds.
cuda cuda-graph cuda-kernels cuda-programming detection onnx ppyoloe tensorrt yolov10 yolov3 yolov5 yolov6 yolov7 yolov8 yolov9
Last synced: 14 May 2025
https://github.com/tencent/forward
A library for high performance deep learning inference on NVIDIA GPUs.
cuda deep-learning forward gpu inference inference-engine keras neural-network onnx pytorch tensorflow tensorrt
Last synced: 05 Apr 2025
https://github.com/Tencent/Forward
A library for high performance deep learning inference on NVIDIA GPUs.
cuda deep-learning forward gpu inference inference-engine keras neural-network onnx pytorch tensorflow tensorrt
Last synced: 18 Apr 2025
https://github.com/mafiosnik777/enhancr
Video Frame Interpolation & Super Resolution using NVIDIA's TensorRT & Tencent's NCNN inference, beautifully crafted and packaged into a single app
amd artificial-intelligence cain dpir electron esrgan frame-interpolation gmfss intel ncnn nvidia realcugan realesrgan rife super-resolution swinir tensorrt upscaling vapoursynth video-processing
Last synced: 05 Apr 2025
https://github.com/VITA-Group/FasterSeg
[ICLR 2020] "FasterSeg: Searching for Faster Real-time Semantic Segmentation" by Wuyang Chen, Xinyu Gong, Xianming Liu, Qian Zhang, Yuan Li, Zhangyang Wang
cityscapes latency neural-architecture-search pytorch semantic-segmentation tensorrt
Last synced: 19 Jul 2025
https://github.com/vita-group/fasterseg
[ICLR 2020] "FasterSeg: Searching for Faster Real-time Semantic Segmentation" by Wuyang Chen, Xinyu Gong, Xianming Liu, Qian Zhang, Yuan Li, Zhangyang Wang
cityscapes latency neural-architecture-search pytorch semantic-segmentation tensorrt
Last synced: 05 Apr 2025
https://github.com/Syencil/tensorRT
TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据
fcos hourglass psenet retinaface retinanet tensorrt yolov3 yolov5
Last synced: 21 Apr 2025
https://github.com/guojianyang/cv-detect-robot
🔥🔥🔥🔥🔥🔥Docker NVIDIA Docker2 YOLOV5 YOLOX YOLO Deepsort TensorRT ROS Deepstream Jetson Nano TX2 NX for High-performance deployment(高性能部署)
deepsort deepstream detection nvidia nvidia-docker ros ros1 tensorrt tensorrt-engine yolo yolov5 yolox yolox-nano
Last synced: 21 Apr 2025
https://github.com/SthPhoenix/InsightFace-REST
InsightFace REST API for easy deployment of face recognition services with TensorRT in Docker.
adaface arcface centerface docker face-detection face-recognition fastapi fp16 gpu insightface mask-detection onnx retinaface scrfd tensorrt tensorrt-conversion yolov5-face
Last synced: 11 Apr 2025
https://github.com/terryky/tflite_gles_app
GPU accelerated deep learning inference applications for RaspberryPi / JetsonNano / Linux PC using TensorflowLite GPUDelegate / TensorRT
facemesh handpose jetson-nano opengl-es opengles raspberry-pi tensorflow tensorflow-lite tensorrt tflite
Last synced: 05 Apr 2025
