"kd" Awesome Lists
awesome-knowledge-distillation
Awesome Knowledge Distillation
co-training deep-learning distillation distillation-model kd knowldge-distillation knowledge-distillation knowledge-transfer model-compression model-distillation
3,664 stars
509 forks
217 projects
Last updated: 06 May 2025
Awesome-Knowledge-Distillation-of-LLMs
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
alignment compression data-augmentation data-synthesis feedback instruction-following kd knowledge-distillation large-language-model llm
997 stars
58 forks
347 projects
Last updated: 25 Apr 2025