{"id":15034449,"url":"https://github.com/feiyull/tensorrt-alpha","last_synced_at":"2025-04-08T08:18:19.014Z","repository":{"id":65307193,"uuid":"534094402","full_name":"FeiYull/TensorRT-Alpha","owner":"FeiYull","description":"🔥🔥🔥TensorRT for YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YOLOv6、YOLOv5、YOLONAS......🚀🚀🚀CUDA IS ALL YOU NEED.🍎🍎🍎","archived":false,"fork":false,"pushed_at":"2024-07-19T13:17:20.000Z","size":38759,"stargazers_count":1326,"open_issues_count":92,"forks_count":199,"subscribers_count":33,"default_branch":"main","last_synced_at":"2025-04-08T08:17:54.317Z","etag":null,"topics":["cuda","efficientdet","libfacedetection","rt-detr","tensorrt","u2net","yolonas","yolor","yolov3","yolov4","yolov5","yolov6","yolov7","yolov8","yolov8-pose","yolov8-seg","yolox"],"latest_commit_sha":null,"homepage":"","language":"C++","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/FeiYull.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-09-08T07:13:16.000Z","updated_at":"2025-04-07T20:24:24.000Z","dependencies_parsed_at":"2023-02-12T01:46:44.379Z","dependency_job_id":"d581772e-0ec9-482b-8cb3-e2a11c527ca9","html_url":"https://github.com/FeiYull/TensorRT-Alpha","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/FeiYull%2FTensorRT-Alpha","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/FeiYull%2FTensorRT-Alpha/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/FeiYull%2FTensorRT-Alpha/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/FeiYull%2FTensorRT-Alpha/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/FeiYull","download_url":"https://codeload.github.com/FeiYull/TensorRT-Alpha/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247801173,"owners_count":20998339,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cuda","efficientdet","libfacedetection","rt-detr","tensorrt","u2net","yolonas","yolor","yolov3","yolov4","yolov5","yolov6","yolov7","yolov8","yolov8-pose","yolov8-seg","yolox"],"created_at":"2024-09-24T20:25:03.865Z","updated_at":"2025-04-08T08:18:18.990Z","avatar_url":"https://github.com/FeiYull.png","language":"C++","readme":"# TensorRT-Alpha\n\u003cdiv align=\"center\"\u003e\n\n  [![Cuda](https://img.shields.io/badge/CUDA-11.3-%2376B900?logo=nvidia)](https://developer.nvidia.com/cuda-toolkit-archive)\n  [![](https://img.shields.io/badge/TensorRT-8.4.2.4-%2376B900.svg?style=flat\u0026logo=tensorrt)](https://developer.nvidia.com/nvidia-tensorrt-8x-download)\n  [![](https://img.shields.io/badge/ubuntu-18.04-orange.svg?style=flat\u0026logo=ubuntu)](https://releases.ubuntu.com/18.04/)\n  [![](https://img.shields.io/badge/windows-10-blue.svg?style=flat\u0026logo=windows)](https://www.microsoft.com/)\n\n  [English](README_en.md) | 简体中文\u003cbr\u003e\n\n  \u003cbr\u003e\n  \u003c/div\u003e\n\n## 可视化\n\u003cdiv align='center'\u003e\n  \u003cimg src='.github/facemesh.jpg' width=\"143px\"\u003e\n  \u003cimg src='.github/people.gif' width=\"338px\"\u003e\n  \u003cimg src='.github/yolov8-snow.gif' height=\"190px\" width=\"230px\"\u003e\n  \u003cbr\u003e\n  \u003cimg src='.github/yolov8-stree.gif'  width=\"260px\"\u003e\n  \u003cimg src='.github/u2net.gif'  width=\"190px\"\u003e\n  \u003cimg src='.github/libfacedet.gif'  width=\"260px\"\u003e\n  \u003cbr\u003e\n\u003c/div\u003e\n\n## 介绍\n本仓库提供深度学习CV领域模型加速部署案例，仓库实现的cuda c支持多batch图像预处理、推理、decode、NMS。大部分模型转换流程为：torch-\u003eonnx-\u003etensorrt。\n获取onnx文件以下有两种方式：\u003cbr\u003e\n\n\u003cdetails\u003e\n\u003csummary\u003epth -\u003e trt\u003c/summary\u003e\ncoming soon.\n\u003c/details\u003e\n\n\u003cdetails\u003e\n\u003csummary\u003epth -\u003e onnx -\u003e trt:\u003c/summary\u003e\n\n- [i]. 本仓库提供的网盘直接下载onnx。[weiyun](https://share.weiyun.com/3T3mZKBm) or [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)\n- [ii]. 按照本仓库提供的指令，手动从相关源代码框架导出onnx。\n\n\u003c/details\u003e\n\n## 更新\n- 2023.01.01  🔥 更新 yolov3, yolov4, yolov5, yolov6\n- 2023.01.04  🍅 更新 yolov7, yolox, yolor\n- 2023.01.05  🎉 更新 u2net, libfacedetection\n- 2023.01.08  🚀 全网最快支持yolov8的tensorrt部署\n- 2023.01.20  🍏  更新 efficientdet, pphunmanseg\n- 2023.12.09  🍁 更新 yolov8-pose\n- 2023.12.19  🍉 更新 yolov8-seg\n- 2023.12.27  💖 更新 yolonas\n\n## 安装\n兼容平台: Windows and Linux. 以下环境已被测过：\u003cbr\u003e\n\u003cdetails\u003e\n\u003csummary\u003eUbuntu18.04\u003c/summary\u003e\n\n- cuda11.3\n- cudnn8.2.0\n- gcc7.5.0\n- tensorrt8.4.2.4\n- opencv3.x or 4.x\n- cmake3.10.2\n\u003c/details\u003e\n\n\u003cdetails\u003e\n\u003csummary\u003eWindows10\u003c/summary\u003e\n\n- cuda11.3 \n- cudnn8.2.0\n- visual studio 2017 or 2019 or 2022\n- tensorrt8.4.2.4\n- opencv3.x or 4.x\n\u003c/details\u003e\n\n\u003cdetails\u003e\n\u003csummary\u003e创建Python环境(可选）\u003c/summary\u003e\n\n```bash\n# install miniconda first\nconda create -n tensorrt-alpha python==3.8 -y\nconda activate tensorrt-alpha\ngit clone https://github.com/FeiYull/tensorrt-alpha\ncd tensorrt-alpha\npip install -r requirements.txt  \n```\n\u003c/details\u003e\n\n安装教程：\n- [Install For Ubuntu18.04](Install_For_Ubuntu18.04/Install_For_Ubuntu18.04.md)\u003cbr\u003e\n- [Docker For Linux](docker/README.md)\u003cbr\u003e\n\n## 快速开始\n### Ubuntu18.04\n设置TensorRT根目录（安装目录）路径:\n```bash\ngit clone https://github.com/FeiYull/tensorrt-alpha\ncd tensorrt-alpha/cmake\nvim common.cmake\n# 把common.cmake文件第20行中的TensorRT_ROOT修改成您的TensorRT安装目录, 例如改成如下:\n# set(TensorRT_ROOT /home/feiyull/TensorRT-8.4.2.4)\n```\n开始编译、运行工程，例如:[yolov8](yolov8/README.md)\n\n## 模型\n目前已实现30多个主流模型，部分整理好的onnx文件如下列表：\n\u003cdiv align='center'\u003e\n\n| model|tesla v100(32G)|weiyun |google driver |\n :-: | :-: | :-: | :-: |\n|[yolov3](yolov3/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)|      \n|[yolov4](yolov4/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)|\n|[yolov5](yolov5/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)|     \n|[yolov6](yolov6/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)|     \n|[yolov7](yolov7/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)|     \n|[yolov8](yolov8/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)|     \n|[yolox](yolox/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)|     \n|[yolor](yolor/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)|     \n|[u2net](u2net/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)|     \n|[libfacedetection](libfacedetection/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)|     \n|[facemesh](facemesh/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)|     \n|[pphumanseg](pphumanseg/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)|  \n|[efficientdet](efficientdet/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)| \n|[yolov8-pose](yolov8-pose/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)| \n|[yolov8-seg](yolov8-seg/README.md)| |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)| \n|[yolonas](yolonas/README.md)|  |[weiyun](https://share.weiyun.com/3T3mZKBm)| [google driver](https://drive.google.com/drive/folders/1-8phZHkx_Z274UVqgw6Ma-6u5AKmqCOv?usp=sharing)| \n|more...(🚀: I will be back soon!)    |      |          |\n\u003c/div\u003e  \n\n🍉稍后在tesla v100 和 A100上测量时间开销!现在看看yolov8n在移动端RTX2070m(8G)的性能表现：\n\u003cdiv align='center'\u003e\n\n| 模型 | 视频分辨率 | 模型输入尺寸 |显存占用 |GPU利用率|\n  :-: | :-: | :-: | :-: | :-: |\n|yolov8n|1920x1080|8x3x640x640|1093MiB/7982MiB| 14%| \n\n \u003ccenter\u003e\t\u003c!--将图片和文字居中--\u003e\n\u003cimg src=\".github/yolov8n-b8-1080p-to-640.jpg\"\n     alt=\"无法显示图片时显示的文字\"\n     style=\"zoom:40%\"/\u003e\n\u003cbr\u003e\t\t\u003c!--换行--\u003e\n\u003ccenter\u003e一个batch内，平均每一帧的时间开销\t\u003c!--标题--\u003e\u003c/center\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n\u003c/div\u003e\n\u003cbr\u003e\n\n## 严格的精度对齐，官方效果 vs TensorRT-Alpha:\n\u003cbr\u003e\n\u003cdiv align='center'\u003e\t\t\t\u003c!--块级封装--\u003e\n     \u003ccenter\u003e\t\u003c!--将图片和文字居中--\u003e\n    \u003cimg src=\".github/yolov8n-Offical(left)vsOurs(right).jpg\"\n         alt=\"无法显示图片时显示的文字\"\n         style=\"zoom:80%\"/\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003ccenter\u003eyolov8n : Offical( left ) vs Ours( right )\t\u003c!--标题--\u003e\u003c/center\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003ccenter\u003e\t\u003c!--将图片和文字居中--\u003e\n    \u003cimg src=\".github/yolov7-tiny-Offical(left)vsOurs(right).jpg\"\n         alt=\"无法显示图片时显示的文字\"\n         style=\"zoom:80%\"/\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003ccenter\u003eyolov7-tiny : Offical( left ) vs Ours( right )\t\u003c!--标题--\u003e\u003c/center\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003cimg src=\".github/yolov6s-v6.3-Offical(left)vsOurs(right).jpg\"\n         alt=\"无法显示图片时显示的文字\"\n         style=\"zoom:80%\"/\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003ccenter\u003eyolov6s : Offical( left ) vs Ours( right )\t\u003c!--标题--\u003e\u003c/center\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003cimg src=\".github/yolov5s-v5.7-Offical(left)vsOurs(right)-img2.jpg\"\n         alt=\"无法显示图片时显示的文字\"\n         style=\"zoom:80%\"/\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003ccenter\u003eyolov5s : Offical( left ) vs Ours( right )\t\u003c!--标题--\u003e\u003c/center\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003cimg src=\".github/yolov5s-v5.7-Offical(left)vsOurs(right)-img1.jpg\"\n         alt=\"无法显示图片时显示的文字\"\n         style=\"zoom:80%\"/\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003ccenter\u003eyolov5s : Offical( left ) vs Ours( right )\t\u003c!--标题--\u003e\u003c/center\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003cimg src=\".github/libfacedet-Offical(left)vsOurs(right-topk-2000).jpg\"\n         alt=\"无法显示图片时显示的文字\"\n         style=\"zoom:100%\"/\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003ccenter\u003elibfacedetection : Offical( left ) vs Ours( right topK:2000)\t\u003c!--标题--\u003e\u003c/center\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003cbr\u003e\t\t\u003c!--换行--\u003e\n    \u003c/center\u003e\n\u003c/div\u003e\n\n\n\n## Citation\n```bash\n@misc{FeiYull_TensorRT-Alpha,  \n  author = {FeiYull},  \n  title = {TensorRT-Alpha},  \n  year = {2023},  \n  publisher = {GitHub},  \n  journal = {GitHub repository},  \n  howpublished = {https://github.com/FeiYull/tensorrt-alpha}\n}\n```","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffeiyull%2Ftensorrt-alpha","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffeiyull%2Ftensorrt-alpha","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffeiyull%2Ftensorrt-alpha/lists"}