Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/CASE-Lab-UMD/Unified-MoE-Compression

The official implementation of the paper "Demystifying the Compression of Mixture-of-Experts Through a Unified Framework".
https://github.com/CASE-Lab-UMD/Unified-MoE-Compression

deep-learning large-language-models machine-learning mixture-of-experts model-compression natural-language-processing

Last synced: 25 days ago
JSON representation

The official implementation of the paper "Demystifying the Compression of Mixture-of-Experts Through a Unified Framework".

Host: GitHub
URL: https://github.com/CASE-Lab-UMD/Unified-MoE-Compression
Owner: CASE-Lab-UMD
License: apache-2.0
Created: 2024-02-24T17:21:26.000Z (10 months ago)
Default Branch: master
Last Pushed: 2024-10-24T15:40:55.000Z (about 2 months ago)
Last Synced: 2024-10-25T21:29:54.285Z (about 2 months ago)
Topics: deep-learning, large-language-models, machine-learning, mixture-of-experts, model-compression, natural-language-processing
Language: Python
Homepage:
Size: 47.1 MB
Stars: 43
Watchers: 2
Forks: 5
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE