Python 24 C++ 2 JavaScript 2 C 2 Jupyter Notebook 2 C# 1

Papers 762 Tools 40 Star History 2

Quantization 296 Pruning and Sparsity 154 Other 130 KV Cache Compression 82 Distillation 58 Efficient Prompting 54 Survey 30

quantization 9 llm 9 llama 7 large-language-models 6 pytorch 4 gpt 3 pruning 3 post-training-quantization 3 llama3 3 qwen 2 cpp 2 ai 2 qlora 2 awq 2 deep-learning 2 c 2 smoothquant 2 transformer 2 alpaca 2 chatglm 2 llama2 2 instruction-tuning 2 lora 2 llamacpp 2 transformers 2 quantization-aware-training 2 language-model 2 lama 1 lamacpp 1 model-para 1 python 1 tensorrt 1 sparse 1 rwkv 1 chatbot 1 onnxruntime 1 chatgpt 1 cot 1 moss 1 p-tuning 1 parameter-efficient 1 tabul 1 tabular-data 1 tabular-model 1 amd 1 cuda 1 deepseek 1 hpu 1 inference 1 inferentia 1