An open API service indexing awesome lists of open source software.

"feedback" Awesome Lists

Awesome-Knowledge-Distillation-of-LLMs

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

alignment compression data-augmentation data-synthesis feedback instruction-following kd knowledge-distillation large-language-model llm

1,015 stars
60 forks
347 projects

Last updated: 07 May 2025

Feedback

Places to get valuable feedback for your every awesome work

awesome-list feedback opengenus wiki

14 stars
0 forks
30 projects

Last updated: 15 Feb 2021

Search
Keywords
awesome-list 3,550 awesome 3,230 machine-learning 418 list 402 awesome-lists 386 deep-learning 358 resources 309 hacktoberfest 238 python 204 lists 197 ai 190 javascript 187 programming 168 security 160 llm 149 artificial-intelligence 136 computer-vision 130 blockchain 129 nlp 109 tools 106 data-science 105 react 101 open-source 100 large-language-models 95 chatgpt 91 android 86 natural-language-processing 84 linux 81 learning 80 css 76 awesome-readme 75 papers 74 curated-list 74 ios 73 ethereum 72 devops 72 awesome-resources 70 nodejs 63 free 62 reinforcement-learning 62 tutorials 61 computer-science 61 rust 60 playground 60 cybersecurity 60 free-resources 58 game-development 58 macos 57 getvm 57 hands-on 56 labex 56 kubernetes 56 robotics 56 java 54 collection 54 privacy 53 golang 52 tutorial 52 design 52 exercises 51 web 50 bitcoin 48 hacking 48 paper 48 frontend 48 go 47 datasets 45 openai 45 survey 45 php 45 swift 45 books 44 education 44 deep-neural-networks 43 cryptocurrency 43 html 43 web3 43 dataset 43 security-tools 42 cloud 42 development 42 gpt 41 data 41 data-visualization 40 vue 39 gamedev 38 llms 38 opensource 38 docker 37 github 37 typescript 36 documentation 36 developer-tools 36 collections 36 courses 35 database 35 research 33 neural-network 33 reactjs 33 paper-list 33 software 32 aws 32 automation 32 framework 32 ml 32 iot 32 game 31 projects 30 community 29 testing 29 free-tutorials 29 cpp 29 hardware 29 ruby 29 graph-neural-networks 28 web-development 28 flutter 28 solidity 28 architecture 28 generative-ai 28 smart-contracts 28 transformer 28 video 28 algorithms 28 games 28 tensorflow 27 libraries 27 dotnet 26 bioinformatics 26 csharp 26 api 26 windows 26 react-native 26 links 26 software-engineering 25 defi 25 music 25 crypto 25 agent 25 git 25 object-detection 24 cryptography 24 pytorch 24 productivity 24 diffusion-models 24 penetration-testing 24 computer-graphics 24 pentesting 24 angular 24 science 24 r 23 unity 23 library 23 embedded 23 django 23 self-supervised-learning 23 gpt-3 22 mobile 22 osint 22 serverless 22 awsome-list 22 microsoft 22 markdown 22 game-engine 22 infosec 22 best-practices 22 gpt-4 22 kotlin 21 ui 21 apple 21 knowledge-graph 21 visualization 21 slam 21 hacktoberfest-accepted 21 self-hosted 21 coding 21 audio 21 engineering 21 roadmap 21 data-analysis 21 multimodal 21 python3 21 neural-networks 21 awesomeness 21 youtube 20 opendata 20 data-mining 20 website 20 jobs 20 mathematics 20 guidelines 20 cloud-computing 20 segmentation 20 programming-language 20 startups 20 apps 20 azure 19 mcp 19 interview 19 saas 19 c 19 deeplearning 19 chinese 19 federated-learning 19 prompt-engineering 19 graph 19 3d 19 sql 19 awsome 19 raspberry-pi 19 blogs 18 cli 18 machinelearning 18 bash 18 time-series 18 marketing 18 front-end 18 bugbounty 18 graphql 18 blog 18 llama 18 chatbot 18 js 18 mlops 18 nextjs 17 curated 17 autonomous-driving 17 foundation-models 17 statistics 17 representation-learning 17 stable-diffusion 17 startup 17 learning-resources 17 language 17 optimization 17 algorithm 17 code 17 microservices 17 decentralized 17 aigc 17 knowledge 17 generative-art 17 networking 17 containers 17 data-structures 16 agents 16 image-processing 16 analytics 16 articles 16 reverse-engineering 16 bert 16 cheatsheet 16 webgl 16 ros 16 big-data 15 graphics 15 ai-agents 15 seo 15 detection 15 devsecops 15 transformers 15 cloud-native 15 pentest 15 nerf 15 distributed-systems 15 technology 15 resource 15 search 15 monitoring 15 readme 15 autonomous-vehicles 15 software-development 15 backend 14 selfhosted 14 prompt 14 react-components 14 dart 14 data-engineering 14 recommender-system 14 mysql 14 icons 14 large-language-model 14 p2p 14 android-development 14 android-library 14 performance 14 node 14 mac 14 telegram 14 terminal 14 webassembly 14 animation 14 vuejs 14 reasoning 14 multimodal-deep-learning 14 speech-recognition 13 open-data 13 search-engine 13 unicorns 13 evm 13 dapp 13 deep-reinforcement-learning 13 elasticsearch 13 command-line 13 foss 13 gis 13 plugins 13 pose-estimation 13 swiftui 13 generative-adversarial-network 13 malware-analysis 13 podcast 13 guide 13 remote-sensing 13 art 13 microservice 13 dotnet-core 13 finance 13 laravel 13 wasm 12 es6 12 ecommerce 12 oss 12 leetcode 12 language-model 12 wordpress 12 gan 12 deepseek 12 frameworks 12 discord 12 postgresql 12 anomaly-detection 12 text-to-image 12 cms 12 pwa 12 static-analysis 12 point-cloud 12 fuzzing 12 storage 12 svelte 12 gaming 12 rails 12 transfer-learning 12 quantum-computing 12 graphics-programming 12 videos 12 font 12 image 12 rest-api 11 rag 11 vscode 11 npm 11 application 11 yolo 11 beginner-friendly 11 course 11 3d-graphics 11 code-generation 11 webapp 11 creative-coding 11 design-systems 11 network 11 question-answering 11 webpack 11 ctf 11 programming-languages 11 objective-c 11 open-science 11 multimodal-learning 11 hacktoberfest2020 11 unity3d 11 databases 11 automl 11 cvpr 11 ui-design 11 planning 11 sustainability 11 bookmarks 11 vision-and-language 11 free-software 11 front-end-development 11 cuda 11 cross-platform 11 sysadmin 11 management 10 reading-list 10 edge-computing 10 multimodal-large-language-models 10 flutter-apps 10 model-compression 10 hosting 10 threat-intelligence 10 text-mining 10 time-series-analysis 10 malware 10 interview-questions 10 unsupervised-learning 10 diffusion 10 solana 10 cv 10 machine-learning-algorithms 10 datascience 10 climate-change 10 speech-processing 10 vlm 10 bug-bounty 10 gpu 10 developer 10 students 10 authentication 10 ansible 10 mcp-server 10 docs 10 bot 10 fpga 10 guides 10 haskell 10 indonesia 10 hacking-tools 10 webdevelopment 10 vr 10 android-app 10 image-generation 10 golang-library 10 interpretability 10 awesome-ai 10 privacy-tools 10 blockchain-technology 10 gpts 10 semantic-web 10 arduino 10 benchmark 10 ai-tools 10 writing 10 movies 10 hacktoberfest2021 10 geospatial 10 medical-imaging 10 chatgpt-api 10 android-application 10 operating-system 10 google 9 trading 9 book 9 neuroscience 9 classification 9 vulnerabilities 9 sentiment-analysis 9 material-design 9 mobile-development 9 chain-of-thought 9 linux-desktop 9 flask 9 cicd 9 reddit 9 video-generation 9 knowledge-base 9 email 9 exploit 9 vision-language-model 9 shell 9 system-design 9 chrome 9 podcasts 9 explainable-ai 9 semantic-segmentation 9 static-site-generator 9 quantization 9 ux 9 social-network 9 ros2 9 elixir 9 article 9 augmented-reality 9 arkit 9 utilities 9 python-library 9 simulation 9 fairness 9 ionic 9 ide 9 applications 9 conference 9 flutter-examples 9 in-context-learning 9 swift-library 9 functional-programming 9 few-shot-learning 9 microservices-architecture 9 profile 9 webcomponents 9 infrastructure-as-code 9 erlang 9 news 9 generative-model 9 anime 9 reference 9 unix 9 websites 9 leadership 9