Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/DaizeDong/Unified-MoE-Compression

The official implementation of the paper "Demystifying the Compression of Mixture-of-Experts Through a Unified Framework".
https://github.com/DaizeDong/Unified-MoE-Compression

deep-learning large-language-models machine-learning mixture-of-experts model-compression natural-language-processing

Last synced: about 1 month ago
JSON representation

The official implementation of the paper "Demystifying the Compression of Mixture-of-Experts Through a Unified Framework".

Host: GitHub
URL: https://github.com/DaizeDong/Unified-MoE-Compression
Owner: DaizeDong
License: apache-2.0
Created: 2024-02-24T17:21:26.000Z (7 months ago)
Default Branch: master
Last Pushed: 2024-08-02T19:47:10.000Z (about 2 months ago)
Last Synced: 2024-08-02T22:42:28.558Z (about 2 months ago)
Topics: deep-learning, large-language-models, machine-learning, mixture-of-experts, model-compression, natural-language-processing
Language: Python
Homepage:
Size: 33.4 MB
Stars: 23
Watchers: 3
Forks: 3
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE