https://github.com/Tencent/Forward

A library for high performance deep learning inference on NVIDIA GPUs.
https://github.com/Tencent/Forward

cuda deep-learning forward gpu inference inference-engine keras neural-network onnx pytorch tensorflow tensorrt

Last synced: 4 days ago
JSON representation

A library for high performance deep learning inference on NVIDIA GPUs.

• Host: GitHub
• URL: https://github.com/Tencent/Forward
• Owner: Tencent
• License: other
• Created: 2021-03-11T02:40:04.000Z (over 3 years ago)
• Default Branch: master
• Last Pushed: 2022-01-29T16:34:05.000Z (almost 3 years ago)
• Last Synced: 2024-08-01T23:31:18.606Z (3 months ago)
• Topics: cuda, deep-learning, forward, gpu, inference, inference-engine, keras, neural-network, onnx, pytorch, tensorflow, tensorrt
• Language: C++
• Homepage:
• Size: 81.1 MB
• Stars: 547
• Watchers: 22
• Forks: 67
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-llmops - Forward - square) | (Optimizations / Profiling)