Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

awesome-mixture-of-experts

A collection of AWESOME things about mixture-of-experts
https://github.com/MachineLearningSystem/awesome-mixture-of-experts

Last synced: 3 days ago
JSON representation

Programming Languages
Python 4
Categories
MoE Model 114 MoE Application 10 MoE System 10 Great Survey 1
Sub Categories
Keywords
pytorch 2 mixture-of-experts 2 zero 1 trillion-parameters 1 pipeline-parallelism 1 model-parallelism 1 machine-learning 1 inference 1 gpu 1 deep-learning 1 data-parallelism 1 compression 1 billion-parameters 1 transformer 1 nlp 1 moe 1