Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists by vectorch-ai
A curated list of projects in awesome lists by vectorch-ai .
https://github.com/vectorch-ai/ScaleLLM
A high-performance inference system for large language models, designed for production environments.
cuda efficiency gpu inference llama llama3 llm llm-inference model performance production serving speculative transformer
Last synced: 16 Nov 2024
https://github.com/vectorch-ai/scalellm
A high-performance inference system for large language models, designed for production environments.
cuda efficiency gpu inference llama llama3 llm llm-inference model performance production serving speculative transformer
Last synced: 20 Dec 2024
https://github.com/vectorch-ai/llmbench
A library for validating and benchmarking LLMs inference.
Last synced: 06 Nov 2024