https://github.com/microsoft/AdaMix
This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.12410).
https://github.com/microsoft/AdaMix
adapter bert dart glue gpt-2 nlg nlp nlu parameter-efficient pytorch roberta webnlg
Last synced: 4 months ago
JSON representation
This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.12410).
- Host: GitHub
- URL: https://github.com/microsoft/AdaMix
- Owner: microsoft
- License: apache-2.0
- Created: 2022-05-24T22:52:02.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2023-08-14T22:22:39.000Z (about 2 years ago)
- Last Synced: 2025-06-20T00:12:54.384Z (4 months ago)
- Topics: adapter, bert, dart, glue, gpt-2, nlg, nlp, nlu, parameter-efficient, pytorch, roberta, webnlg
- Language: Python
- Homepage:
- Size: 16.7 MB
- Stars: 133
- Watchers: 4
- Forks: 11
- Open Issues: 25
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Security: SECURITY.md
- Support: SUPPORT.md