Python 24 C 3 C++ 3 JavaScript 2 Jupyter Notebook 2 C# 1

Papers 536 Tools 40 Star History 1

Quantization 218 Pruning and Sparsity 117 Other 105 Distillation 44 Efficient Prompting 41 KV Cache Compression 32 Survey 20

llm 10 quantization 9 llama 9 large-language-models 9 ai 4 gpt 4 instruction-tuning 3 chatglm 3 lora 3 transformers 3 deep-learning 3 pruning 3 pytorch 3 llama3 3 language-model 3 llms 2 transformer 2 c 2 llamacpp 2 llama2 2 cpp 2 post-training-quantization 2 quantization-aware-training 2 ggml 2 alpaca 2 rlhf 2 qwen 2 qlora 2 peft 2 moe 2 mistral 2 fine-tuning 2 agent 2 tabular-data 1 tabular-model 1 chatgpt 1 cot 1 moss 1 p-tuning 1 python 1 lamacpp 1 lama 1 parameter-efficient 1 amd 1 cuda 1 tabul 1 inference 1 rwkv 1 inferentia 1 onnxruntime 1