Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

awesome-mixture-of-experts

A collection of AWESOME things about mixture-of-experts
https://github.com/XueFuzhao/awesome-mixture-of-experts

Last synced: 3 days ago
JSON representation

Programming Languages
Python 9
Categories
MoE Model 128 MoE Application 11 MoE System 10 Uncategorized 6 Must Read 6
Sub Categories
Uncategorized 6
Keywords
mixture-of-experts 5 moe 3 deep-learning 2 machine-learning 2 pytorch 2 continual-pre-training 1 expert-partition 1 llama 1 llm 1 large-language-models 1 model-compression 1 natural-language-processing 1 adaptive-computation 1 dynamic-neural-network 1 language-model 1 multimodal-large-language-models 1 nlp 1 transformer 1 billion-parameters 1 compression 1 data-parallelism 1 gpu 1 inference 1 model-parallelism 1 pipeline-parallelism 1 trillion-parameters 1 zero 1