https://github.com/sozercan/k8s-distributed-inference

🦄 Distributed Inference on Kubernetes with DRA and MIG

dra dynamic-resource-allocation inference kubernetes llm multi-instance-gpu nvidia

Last synced: 12 Apr 2025