awesome-mixture-of-experts

A collection of AWESOME things about mixture-of-experts
https://github.com/XueFuzhao/awesome-mixture-of-experts

Last synced: about 23 hours ago
JSON representation

Programming Languages

Categories

MoE Model 149 MoE Application 10 MoE System 10 Uncategorized 6 Must Read 6

Sub Categories

Uncategorized 6

Keywords

mixture-of-experts 5 moe 3 llm 2 deep-learning 2 natural-language-processing 2 model-compression 2 machine-learning 2 large-language-models 2 continual-pre-training 1 expert-partition 1 llama 1 adaptive-computation 1 dynamic-neural-network 1 language-model 1 multimodal-large-language-models 1 deepseek 1 deepseek-r1 1 pytorch 1