https://github.com/TRT2022/trtllm-llama
☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
https://github.com/TRT2022/trtllm-llama
Last synced: 1 day ago
JSON representation
☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
- Host: GitHub
- URL: https://github.com/TRT2022/trtllm-llama
- Owner: TRT2022
- License: apache-2.0
- Created: 2023-08-21T02:57:17.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-10-20T01:23:34.000Z (over 1 year ago)
- Last Synced: 2024-08-03T01:16:43.597Z (9 months ago)
- Language: C++
- Homepage:
- Size: 52.6 MB
- Stars: 39
- Watchers: 0
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-llm-and-aigc - TRT2022/trtllm-llama - llama?style=social"/> : ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化。 (Summary)
- awesome-llm-and-aigc - TRT2022/trtllm-llama - llama?style=social"/> : ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化。 (Summary)
- awesome-cuda-and-hpc - TRT2022/trtllm-llama - llama?style=social"/> : ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化。 (Frameworks)
- awesome-cuda-and-hpc - TRT2022/trtllm-llama - llama?style=social"/> : ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化。 (Frameworks)