https://github.com/neuralmagic/nm-vllm-utils

Various utilities for use with nm-vllm
https://github.com/neuralmagic/nm-vllm-utils

Last synced: 3 months ago
JSON representation

Various utilities for use with nm-vllm

• Host: GitHub
• URL: https://github.com/neuralmagic/nm-vllm-utils
• Owner: neuralmagic
• License: apache-2.0
• Created: 2024-04-25T13:50:07.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2024-05-31T13:19:18.000Z (about 2 years ago)
• Last Synced: 2024-05-31T14:18:41.626Z (about 2 years ago)
• Language: Makefile
• Homepage:
• Size: 68.4 KB
• Stars: 0
• Watchers: 12
• Forks: 0
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
[![Code Coverage Badge](./.meta/coverage/badge.svg)](./.meta/coverage/report.txt)

[![License](https://img.shields.io/github/license/neuralmagic/nm-vllm-utils.svg)](https://github.com/neuralmagic/nm-vllm-utils/blob/main/LICENSE)

# NM vLLM Utilities

Various utilities for use with [nm-vllm](https://github.com/neuralmagic/nm-vllm).