https://github.com/beanie00/self-distillation-analysis

Codebase for the work “Why Does Self-Distillation (Sometimes) Degrade the Reasoning Capability of LLMs?”
https://github.com/beanie00/self-distillation-analysis

Last synced: about 1 month ago
JSON representation

Codebase for the work “Why Does Self-Distillation (Sometimes) Degrade the Reasoning Capability of LLMs?”

• Host: GitHub
• URL: https://github.com/beanie00/self-distillation-analysis
• Owner: beanie00
• License: apache-2.0
• Created: 2026-03-19T13:19:55.000Z (4 months ago)
• Default Branch: main
• Last Pushed: 2026-04-14T13:34:21.000Z (3 months ago)
• Last Synced: 2026-04-14T15:29:07.641Z (3 months ago)
• Language: Python
• Homepage: https://beanie00.notion.site/why-does-self-distillation-degrade-reasoning?source=copy_link
• Size: 19.2 MB
• Stars: 47
• Watchers: 0
• Forks: 6
• Open Issues: 1

Awesome Lists containing this project

• awesomeopd - self-distillation-analysis - distillation-analysis?style=for-the-badge&logo=github&logoColor=white&labelColor=181717&color=ffd700" alt="Stars"> | 2026.03 | MSR / KAIST / SNU | [arXiv 2603.24472](https://arxiv.org/abs/2603.24472) | **Why Does Self-Distillation (Sometimes) Degrade Reasoning?** — diagnostic study of OPSD failure modes | (♻️ Self-Distillation with Privileged Context — OPSD)