Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists by ModelTC
A curated list of projects in awesome lists by ModelTC .
https://github.com/ModelTC/lightllm
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
deep-learning gpt llama llm model-serving nlp openai-triton
Last synced: 31 Jul 2024
https://github.com/ModelTC/EasyLLM
Built upon Megatron-Deepspeed and HuggingFace Trainer, EasyLLM has reorganized the code logic with a focus on usability. While enhancing usability, it also ensures training efficiency.
Last synced: 03 Aug 2024
https://github.com/ModelTC/llmc
llmc is an efficient LLM compression tool with various advanced compression methods, supporting multiple inference backends.
benchmark deployment evaluation large-language-models llm pruning quantization tool
Last synced: 02 Aug 2024