https://github.com/gpustack/runtime

Provides a unified interface to detect GPU resources and manages GPU workloads.
https://github.com/gpustack/runtime

Last synced: 3 months ago
JSON representation

Provides a unified interface to detect GPU resources and manages GPU workloads.

• Host: GitHub
• URL: https://github.com/gpustack/runtime
• Owner: gpustack
• License: apache-2.0
• Created: 2025-09-08T10:20:49.000Z (10 months ago)
• Default Branch: main
• Last Pushed: 2026-04-02T08:22:40.000Z (3 months ago)
• Last Synced: 2026-04-02T23:15:37.893Z (3 months ago)
• Language: Python
• Homepage:
• Size: 1.04 MB
• Stars: 12
• Watchers: 0
• Forks: 15
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# GPUStack Runtime

GPUStack Runtime offers a unified interface for detecting GPU resources and managing GPU workloads.

It supports detection of a wide range of GPU and accelerator resources, including:

- AMD GPU

- Ascend NPU

- Cambricon MLU

- Hygon DCU

- Iluvatar GPU

- MetaX GPU

- Moore Threads GPU

- NVIDIA GPU

- T-Head PPU

Contributions to support additional GPU resources are welcome!

GPUStack Runtime enables GPU workload management on the following platforms:

- Docker

- Kubernetes

- Podman (>=4.9, Experimental support via `CONTAINER_HOST=http+unix:///path/to/podman/socket` environment variable)

## License

Copyright (c) 2025 The GPUStack authors

Licensed under the Apache License, Version 2.0 (the "License");

you may not use this file except in compliance with the License.

You may obtain a copy of the License at [LICENSE](./LICENSE) file for details.

Unless required by applicable law or agreed to in writing, software

distributed under the License is distributed on an "AS IS" BASIS,

WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

See the License for the specific language governing permissions and

limitations under the License.