0 "knowledge-distillation" Awesome Lists
awesome-knowledge-distillation
Awesome Knowledge Distillation
co-training deep-learning distillation distillation-model kd knowldge-distillation knowledge-distillation knowledge-transfer model-compression model-distillation
3,835 stars
513 forks
228 projects
Last updated: 06 Apr 2026
Awesome-Efficient-LLM
A curated list for Efficient Large Language Models
compression efficient-llm knowledge-distillation language-model llm llm-compression model-quantization pruning-algorithms
1,979 stars
157 forks
217 projects
Last updated: 07 Apr 2026
Awesome-Knowledge-Distillation-of-LLMs
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
alignment compression data-augmentation data-synthesis feedback instruction-following kd knowledge-distillation large-language-model llm
1,258 stars
69 forks
347 projects
Last updated: 27 Feb 2026
awesome-ai-infrastructures
Infrastructures™ for Machine Learning Training/Inference in Production.
apache-arrow apache-mesos apache-spark artificial-intelligence awesome-list deep-learning deep-learning-framework federated-learning knowledge-distillation kubernetes
443 stars
82 forks
31 projects
Last updated: 28 Mar 2026
bert-in-production
A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.
awesome bert bert-pytorch deployment distilbert elmo implementation knowledge-distillation language language-models
96 stars
12 forks
45 projects
Last updated: 13 Jan 2025
awesome-tinyml
TinyML & Edge AI: On-device inference, model quantization, embedded ML, ultra-low-power AI for microcontrollers and IoT devices.
arduino cortex-m edge-ai edge-computing embedded-ml embedded-systems esp32 iot knowledge-distillation microcontroller
40 stars
1 forks
227 projects
Last updated: 01 Apr 2026
awesome-nlp-references
A curated list of resources dedicated to Knowledge Distillation, Recommendation System, especially Natural Language Processing (NLP).
awesome-list awesome-nlp deep-learning knowledge-distillation machine-learning natural-language-processing neural-networks nlp nlp-references nlp-resources
34 stars
5 forks
58 projects
Last updated: 08 Nov 2025
awesome-loss-functions
📚 350+ loss functions across 25+ AI subdomains — classification, GANs, diffusion, LLM alignment, RL, contrastive learning, audio, video, time series, and more. Chronologically ordered with paper links, math formulas, and implementations.
awesome awesome-list computer-vision contrastive-learning deep-learning diffusion-models gan generative-models knowledge-distillation llm-alignment
3 stars
0 forks
341 projects
Last updated: 14 Mar 2026