https://github.com/SJTU-IPADS/reef

REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU scheduling.
https://github.com/SJTU-IPADS/reef

Last synced: 4 days ago
JSON representation

REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU scheduling.

• Host: GitHub
• URL: https://github.com/SJTU-IPADS/reef
• Owner: SJTU-IPADS
• License: apache-2.0
• Created: 2022-05-27T03:06:39.000Z (almost 3 years ago)
• Default Branch: main
• Last Pushed: 2022-12-24T14:49:00.000Z (over 2 years ago)
• Last Synced: 2024-08-02T18:40:59.021Z (9 months ago)
• Language: Cuda
• Homepage:
• Size: 67 MB
• Stars: 84
• Watchers: 10
• Forks: 6
• Open Issues: 4
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-real-time-AI - REEF