"kd" Awesome Lists
awesome-knowledge-distillation
Awesome Knowledge Distillation
co-training deep-learning distillation distillation-model kd knowldge-distillation knowledge-distillation knowledge-transfer model-compression model-distillation
          
            3,751 stars 
            511 forks 
            218 projects
          
        
Last updated: 14 Oct 2025
Awesome-Knowledge-Distillation-of-LLMs
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
alignment compression data-augmentation data-synthesis feedback instruction-following kd knowledge-distillation large-language-model llm
          
            1,122 stars 
            67 forks 
            347 projects
          
        
Last updated: 04 Aug 2025