https://github.com/DaizeDong/Unified-MoE-Compression

The official implementation of the paper "Demystifying the Compression of Mixture-of-Experts Through a Unified Framework".
https://github.com/DaizeDong/Unified-MoE-Compression

deep-learning large-language-models machine-learning mixture-of-experts model-compression natural-language-processing

Last synced: 4 months ago
JSON representation

The official implementation of the paper "Demystifying the Compression of Mixture-of-Experts Through a Unified Framework".

Host: GitHub
URL: https://github.com/DaizeDong/Unified-MoE-Compression
Owner: CASE-Lab-UMD
License: apache-2.0
Created: 2024-02-24T17:21:26.000Z (about 1 year ago)
Default Branch: master
Last Pushed: 2024-10-24T15:40:55.000Z (6 months ago)
Last Synced: 2024-12-09T04:04:14.030Z (4 months ago)
Topics: deep-learning, large-language-models, machine-learning, mixture-of-experts, model-compression, natural-language-processing
Language: Python
Homepage:
Size: 47.1 MB
Stars: 48
Watchers: 2
Forks: 5
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE

ecosyste.ms