https://github.com/microsoft/vidur

A large-scale simulation framework for LLM inference
https://github.com/microsoft/vidur

inference llm simulation transformer vllm

Last synced: 3 months ago
JSON representation

A large-scale simulation framework for LLM inference

• Host: GitHub
• URL: https://github.com/microsoft/vidur
• Owner: microsoft
• License: mit
• Created: 2023-11-02T10:05:21.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-05-15T21:57:26.000Z (6 months ago)
• Last Synced: 2024-05-28T15:02:04.742Z (5 months ago)
• Topics: inference, llm, simulation, transformer, vllm
• Language: Python
• Homepage:
• Size: 148 MB
• Stars: 77
• Watchers: 6
• Forks: 6
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Security: SECURITY.md
  • Support: SUPPORT.md

Awesome Lists containing this project

• StarryDivineSky - microsoft/vidur