https://github.com/leoho0722/kubeai-llm-gpu-scheduler

Design of a GPU Dynamic LLM Inference Task Scheduling Architecture Based on KubeAI

gpu-scheduling kubeai kubernetes langtrace llm-inference monitoring prometheus

Last synced: 28 Aug 2025