Ecosyste.ms: Awesome

https://github.com/AviSoori1x/makeMoE

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

deep-learning large-language-models llm mixture-of-experts neural-networks pytorch pytorch-implementation

Last synced: 05 Nov 2024