https://github.com/ardawanism/knowledge-distillation-series

In this repository, comprehensive and step by step explanation and implementation of lots of Knowledge Distillation algorithms are provided.
https://github.com/ardawanism/knowledge-distillation-series

knowledge-distillation

Last synced: 6 days ago
JSON representation

In this repository, comprehensive and step by step explanation and implementation of lots of Knowledge Distillation algorithms are provided.

• Host: GitHub
• URL: https://github.com/ardawanism/knowledge-distillation-series
• Owner: Ardawanism
• Created: 2024-02-15T22:28:04.000Z (12 months ago)
• Default Branch: master
• Last Pushed: 2024-02-15T22:36:05.000Z (12 months ago)
• Last Synced: 2024-02-15T23:39:13.617Z (12 months ago)
• Topics: knowledge-distillation
• Language: Jupyter Notebook
• Homepage: https://youtube.com/playlist?list=PLGTjaX8tZ8ad9270YuKIndXieJ8ELFwzd&si=kvjNbKpECKjOLY4c
• Size: 200 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Knowledge Distillation series

## The first implemented paper is Hinton, G., Vinyals, O. and Dean, J., 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531.

Paper link: https://arxiv.org/abs/1503.02531

Video link: https://youtu.be/9guKFI_yVNc?si=pK0MqV_hkc-P6lhC