Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

awesome-mixture-of-experts

A collection of AWESOME things about mixture-of-experts
https://github.com/XueFuzhao/awesome-mixture-of-experts

Programming Languages

Keywords

mixture-of-experts 5 moe 3 pytorch 2 deep-learning 2 machine-learning 2 nlp 1 transformer 1 billion-parameters 1 compression 1 data-parallelism 1 gpu 1 inference 1 model-parallelism 1 pipeline-parallelism 1 trillion-parameters 1 zero 1 large-language-models 1 model-compression 1 natural-language-processing 1 bert 1 multimodal-large-language-models 1 phi-2 1 qwen 1 stablelm 1 vision-transformer 1 continual-pre-training 1 expert-partition 1 llama 1 llm 1