https://github.com/sayakpaul/funmatch-distillation

TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.
https://github.com/sayakpaul/funmatch-distillation

bit-resnet image-classification keras knowledge-distillation tensorflow tpu transfer-learning vision

Last synced: 4 days ago
JSON representation

TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.

• Host: GitHub
• URL: https://github.com/sayakpaul/funmatch-distillation
• Owner: sayakpaul
• Created: 2021-07-24T10:08:15.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2021-09-24T00:58:57.000Z (about 3 years ago)
• Last Synced: 2024-10-23T14:01:59.800Z (14 days ago)
• Topics: bit-resnet, image-classification, keras, knowledge-distillation, tensorflow, tpu, transfer-learning, vision
• Language: Jupyter Notebook
• Homepage: https://keras.io/examples/keras_recipes/better_knowledge_distillation/
• Size: 1.37 MB
• Stars: 87
• Watchers: 4
• Forks: 8
• Open Issues: 1

Awesome Lists containing this project