Projects in Awesome Lists by vectorch-ai
A curated list of projects in awesome lists by vectorch-ai .
https://github.com/vectorch-ai/ScaleLLM
A high-performance inference system for large language models, designed for production environments.
cuda efficiency gpu inference llama llama3 llm llm-inference model performance production serving speculative transformer
Last synced: 09 May 2025
https://github.com/vectorch-ai/scalellm
A high-performance inference system for large language models, designed for production environments.
cuda efficiency gpu inference llama llama3 llm llm-inference model performance production serving speculative transformer
Last synced: 14 Apr 2025
https://github.com/vectorch-ai/llmbench
A library for validating and benchmarking LLMs inference.
Last synced: 22 Aug 2025