https://github.com/kubernetes-sigs/inference-perf

GenAI inference performance benchmarking tool
https://github.com/kubernetes-sigs/inference-perf

k8s-sig-scalability

Last synced: about 2 months ago
JSON representation

GenAI inference performance benchmarking tool

• Host: GitHub
• URL: https://github.com/kubernetes-sigs/inference-perf
• Owner: kubernetes-sigs
• License: apache-2.0
• Created: 2025-01-14T22:26:31.000Z (5 months ago)
• Default Branch: main
• Last Pushed: 2025-03-31T22:12:39.000Z (3 months ago)
• Last Synced: 2025-04-21T06:55:26.002Z (about 2 months ago)
• Topics: k8s-sig-scalability
• Language: Python
• Homepage:
• Size: 213 KB
• Stars: 39
• Watchers: 9
• Forks: 11
• Open Issues: 20
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: code-of-conduct.md
  • Security: SECURITY.md

Awesome Lists containing this project

• Awesome-LLMOps - Inference Perf - sigs/inference-perf.svg?style=flat&color=green)   (Inference / Benchmark)