awesome-adapter-resources
Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
https://github.com/calpt/awesome-adapter-resources
Last synced: about 1 hour ago
JSON representation
-
Frameworks and Tools
- [Paper PDF - Edgerunners/LLM-Adapters) [[Semantic Scholar]](https://www.semanticscholar.org/paper/bdb68c5e2369633b20e733774ac66eb4600c34d1)
- [Paper PDF - hub/adapters) [[Semantic Scholar]](https://www.semanticscholar.org/paper/e1f4b94479bfcb735a1a0add178a2337def07c9b)
- GitHub Repo stars
- [Code
- GitHub Repo stars
- GitHub Repo stars
- [Code
- [Paper PDF - hub/adapter-transformers) [[Website]](https://adapterhub.ml) [[Semantic Scholar]](https://www.semanticscholar.org/paper/063f8b1ecf2394ca776ac61869734de9c1953808)
- GitHub Repo stars
- [Paper PDF - hub/adapters) [[Semantic Scholar]](https://www.semanticscholar.org/paper/e1f4b94479bfcb735a1a0add178a2337def07c9b)
- GitHub Repo stars
- [Code
- GitHub Repo stars
- [Code
- GitHub Repo stars
- GitHub Repo stars
- [Code
- [Paper PDF - hub/adapter-transformers) [[Website]](https://adapterhub.ml) [[Semantic Scholar]](https://www.semanticscholar.org/paper/063f8b1ecf2394ca776ac61869734de9c1953808)
- GitHub Repo stars
- [Paper PDF - hub/adapters) [[Semantic Scholar]](https://www.semanticscholar.org/paper/e1f4b94479bfcb735a1a0add178a2337def07c9b)
- GitHub Repo stars
- [Code
-
Surveys
-
Natural Language Processing
-
Methods
- [Paper PDF - research/adapter-bert) [[Semantic Scholar]](https://www.semanticscholar.org/paper/29ddc1f43f28af7c846515e32cc167bc66886d0c)
- [Paper PDF
- [Paper PDF
- [Paper PDF
- [Paper PDF
- [Paper PDF - three/t-few) [[Semantic Scholar]](https://www.semanticscholar.org/paper/7cdaa08890895e1ad92afb5fad429690ad7b1dac)
- [Paper PDF
- [Paper PDF
- GitHub Repo stars - Diff%20pruning-blue)
- [Paper PDF
- GitHub Repo stars - Prefix--Tuning-blue)
- [Paper PDF
- GitHub Repo stars - Prompt%20Tuning-blue)
- GitHub Repo stars - Bottleneck%20adapter-blue)
- [Paper PDF - research/adapter-bert) [[Semantic Scholar]](https://www.semanticscholar.org/paper/29ddc1f43f28af7c846515e32cc167bc66886d0c)
- GitHub Repo stars - K--Adapter-blue)
- [Paper PDF - Adapter) [[Semantic Scholar]](https://www.semanticscholar.org/paper/4f03e69963b9649950ba29ae864a0de8c14f1f86)
- [Paper PDF - research/prompt-tuning) [[Semantic Scholar]](https://www.semanticscholar.org/paper/ffdbd7f0b03b85747b001b4734d5ee31b5229aa4)
- GitHub Repo stars - Compacter-blue)  
- [Paper PDF
- GitHub Repo stars - LoRA-blue)
- [Paper PDF
- GitHub Repo stars - HyperFormer-blue)
- [Paper PDF
- [Paper PDF
- GitHub Repo stars - BitFit-blue)
- [Paper PDF
- GitHub Repo stars - T--Few-blue) ^3-blue)
- [Paper PDF - three/t-few) [[Semantic Scholar]](https://www.semanticscholar.org/paper/7cdaa08890895e1ad92afb5fad429690ad7b1dac)
- GitHub Repo stars - AutoPEFT-blue)
- [Paper PDF
- GitHub Repo stars - AdaLoRA-blue)
- [Paper PDF
- GitHub Repo stars - QLoRA-blue)
- GitHub Repo stars - LT--SFT-blue)
- [Paper PDF - sft) [[Semantic Scholar]](https://www.semanticscholar.org/paper/fc58779940abb92166b73f47867763a07368c739)
- GitHub Repo stars - DoRA-blue) 
- [Paper PDF - research/prompt-tuning) [[Semantic Scholar]](https://www.semanticscholar.org/paper/ffdbd7f0b03b85747b001b4734d5ee31b5229aa4)
- GitHub Repo stars - Compacter-blue)  
- [Paper PDF
- GitHub Repo stars - LoRA-blue)
- [Paper PDF
- GitHub Repo stars - HyperFormer-blue)
- GitHub Repo stars - Bottleneck%20adapter-blue)
- [Paper PDF - research/adapter-bert) [[Semantic Scholar]](https://www.semanticscholar.org/paper/29ddc1f43f28af7c846515e32cc167bc66886d0c)
- GitHub Repo stars - K--Adapter-blue)
- [Paper PDF - Adapter) [[Semantic Scholar]](https://www.semanticscholar.org/paper/4f03e69963b9649950ba29ae864a0de8c14f1f86)
- GitHub Repo stars - Diff%20pruning-blue)
- [Paper PDF
- GitHub Repo stars - Prefix--Tuning-blue)
- [Paper PDF
- GitHub Repo stars - Prompt%20Tuning-blue)
- [Paper PDF
- [Paper PDF
- GitHub Repo stars - BitFit-blue)
- [Paper PDF - three/t-few) [[Semantic Scholar]](https://www.semanticscholar.org/paper/7cdaa08890895e1ad92afb5fad429690ad7b1dac)
- GitHub Repo stars - AutoPEFT-blue)
- [Paper PDF
- GitHub Repo stars - AdaLoRA-blue)
- [Paper PDF
- GitHub Repo stars - QLoRA-blue)
- GitHub Repo stars - LT--SFT-blue)
- [Paper PDF
- [Paper PDF
- [Paper PDF
- GitHub Repo stars - ReFT-blue)  
- [Paper PDF
-
Composition Methods
- [Paper PDF - parameter-efficient-tuning) [[Semantic Scholar]](https://www.semanticscholar.org/paper/43a87867fe6bf4eb920f97fc753be4b727308923)
- [Paper PDF
- GitHub Repo stars - Mix--and--Match%20adapters-blue) 
- [Paper PDF - hub/adapter-transformers) [[Semantic Scholar]](https://www.semanticscholar.org/paper/26299d5fdc5137291dc6a091573b3d18aba1d1c2)
- [Paper PDF - hub/adapter-transformers) [[Semantic Scholar]](https://www.semanticscholar.org/paper/98ef0db84e62aef969629264c9de1f4d0013f3b9)
- [Paper PDF - hub/adapter-transformers) [[Semantic Scholar]](https://www.semanticscholar.org/paper/26299d5fdc5137291dc6a091573b3d18aba1d1c2)
- [Paper PDF - hub/adapter-transformers) [[Semantic Scholar]](https://www.semanticscholar.org/paper/98ef0db84e62aef969629264c9de1f4d0013f3b9)
- GitHub Repo stars - Mix--and--Match%20adapters-blue) 
- [Paper PDF - parameter-efficient-tuning) [[Semantic Scholar]](https://www.semanticscholar.org/paper/43a87867fe6bf4eb920f97fc753be4b727308923)
- GitHub Repo stars - AdaMix-blue)  
- [Paper PDF
- GitHub Repo stars - Model%20merging-blue)
- [Paper PDF - parameter-efficient-tuning) [[Semantic Scholar]](https://www.semanticscholar.org/paper/43a87867fe6bf4eb920f97fc753be4b727308923)
- GitHub Repo stars - AdaMix-blue)  
- [Paper PDF
- GitHub Repo stars - Model%20merging-blue)
- [Paper PDF - nlp/PEM_composition) [[Semantic Scholar]](https://www.semanticscholar.org/paper/7f1a473834eea608980e4e04cce21be18d65b9b6)
- [Paper PDF
- GitHub Repo stars - Polytropon-blue)
- [Paper PDF - NLP/polytropon) [[Semantic Scholar]](https://www.semanticscholar.org/paper/0d56e3d69c9b3112d77187f96fabcfbdf5303971)
- GitHub Repo stars - Multi--Head%20routing-blue)
- [Paper PDF
- [Paper PDF - ai/parameter-efficient-moe) [[Semantic Scholar]](https://www.semanticscholar.org/paper/5aae7d84f8eaa55f3386cee41d94769e7ab01e9d)
- [Paper PDF - nlp/PEM_composition) [[Semantic Scholar]](https://www.semanticscholar.org/paper/7f1a473834eea608980e4e04cce21be18d65b9b6)
- [Paper PDF
- GitHub Repo stars - Polytropon-blue)
- [Paper PDF - NLP/polytropon) [[Semantic Scholar]](https://www.semanticscholar.org/paper/0d56e3d69c9b3112d77187f96fabcfbdf5303971)
- GitHub Repo stars - Multi--Head%20routing-blue)
- [Paper PDF
- GitHub Repo stars - MoE-blue)   
- [Paper PDF - ai/parameter-efficient-moe) [[Semantic Scholar]](https://www.semanticscholar.org/paper/5aae7d84f8eaa55f3386cee41d94769e7ab01e9d)
- GitHub Repo stars - AdapterFusion-blue)
- GitHub Repo stars - AdapterFusion-blue)
-
Analysis and Evaluation
- [Paper PDF
- [Paper PDF
- GitHub Repo stars - P--Tuning%20v2-blue) 
- [Paper PDF - tuning-v2) [[Semantic Scholar]](https://www.semanticscholar.org/paper/ec936b808e0fab9281c050ad4010cddec92c8cbe)
- [Paper PDF
- GitHub Repo stars - UniPELT-blue)
- GitHub Repo stars - ConceptNet-blue)
- [Paper PDF
- [Paper PDF
- - Parallel%20inference-blue)
- [Paper PDF
- GitHub Repo stars - Intermediate%20task%20transfer-blue)
- [Paper PDF - hub/efficient-task-transfer) [[Semantic Scholar]](https://www.semanticscholar.org/paper/7b99c51d562e33309a46601c846abbe72a65c6a4)
- [Paper PDF
- GitHub Repo stars - ConceptNet-blue)
- [Paper PDF
- [Paper PDF
- [Paper PDF
- - Parallel%20inference-blue)
- [Paper PDF
- GitHub Repo stars - Intermediate%20task%20transfer-blue)
- [Paper PDF - hub/efficient-task-transfer) [[Semantic Scholar]](https://www.semanticscholar.org/paper/7b99c51d562e33309a46601c846abbe72a65c6a4)
- GitHub Repo stars - P--Tuning%20v2-blue) 
- [Paper PDF - tuning-v2) [[Semantic Scholar]](https://www.semanticscholar.org/paper/ec936b808e0fab9281c050ad4010cddec92c8cbe)
- [Paper PDF
- GitHub Repo stars - UniPELT-blue)
- [Paper PDF
-
Applications
- [Paper PDF - adapter) [[Semantic Scholar]](https://www.semanticscholar.org/paper/a757999ed260d7bc45484dc6b4456bf33fe6f679)
- [Paper PDF
- [Paper PDF
- [Paper PDF
- GitHub Repo stars - UDapter-blue) 
- [Paper PDF
- GitHub Repo stars - Bottleneck%20adapter-blue) 
- [Paper PDF - nlp/made) [[Semantic Scholar]](https://www.semanticscholar.org/paper/67dc4ba4542d5895862c8b5af5023f659c14542c)
- [Paper PDF
- - Machine%20Translation-blue)
- [Paper PDF
- GitHub Repo stars - EMEA-blue)
- [Paper PDF
- GitHub Repo stars - Prefix--Tuning-blue) 
- - Machine%20Translation-blue)
- [Paper PDF
- [Paper PDF
- GitHub Repo stars - Bottleneck%20adapter-blue) 
- [Paper PDF - nlp/made) [[Semantic Scholar]](https://www.semanticscholar.org/paper/67dc4ba4542d5895862c8b5af5023f659c14542c)
- [Paper PDF
- [Paper PDF
- - Machine%20Translation-blue)
- [Paper PDF
- GitHub Repo stars - EMEA-blue)
- [Paper PDF
- GitHub Repo stars - Prefix--Tuning-blue) 
- [Paper PDF - adapter) [[Semantic Scholar]](https://www.semanticscholar.org/paper/a757999ed260d7bc45484dc6b4456bf33fe6f679)
-
Serving
- GitHub Repo stars - Punica-blue) 
- [Paper PDF - ai/punica) [[Semantic Scholar]](https://www.semanticscholar.org/paper/c2314751d367b34239a537fe27e2bd51a8b84528)
- GitHub Repo stars - S--LoRA-blue) 
- [Paper PDF - LoRA/S-LoRA) [[Semantic Scholar]](https://www.semanticscholar.org/paper/9bb8c4325c609caeade9c3ed7036d2b9953e278c)
- GitHub Repo stars - Punica-blue) 
- [Paper PDF - ai/punica) [[Semantic Scholar]](https://www.semanticscholar.org/paper/c2314751d367b34239a537fe27e2bd51a8b84528)
- GitHub Repo stars - S--LoRA-blue) 
- [Paper PDF - LoRA/S-LoRA) [[Semantic Scholar]](https://www.semanticscholar.org/paper/9bb8c4325c609caeade9c3ed7036d2b9953e278c)
-
-
Computer Vision
-
Methods
- [Paper PDF
- [Paper PDF
- [Paper PDF
- GitHub Repo stars - Bottleneck%20adapter-blue)
- [Paper PDF
- [Paper PDF
- [Paper PDF
- GitHub Repo stars - Bottleneck%20adapter-blue)  
- [Paper PDF
- [Paper PDF
- [Paper PDF
- [Paper PDF
- GitHub Repo stars - Bottleneck%20adapter-blue)  
- [Paper PDF
-
-
Audio Processing
-
Applications
- [Paper PDF
- GitHub Repo stars - Speech%20translation-blue)
- [Paper PDF
- [Paper PDF
- GitHub Repo stars - Speech%20translation-blue)
- [Paper PDF
- [Paper PDF
-
-
Multi-Modal
-
Methods
- [Paper PDF - PET) [[Website]](https://henryhzy.github.io/VL-PET) [[Semantic Scholar]](https://www.semanticscholar.org/paper/80a791f644defb54f4eb24f99df31e6f995be3aa)
- [Paper PDF - side-tuning) [[Semantic Scholar]](https://www.semanticscholar.org/paper/960d40497717ad22a7ebb84db238fa2415fc89cc)
- GitHub Repo stars - VL--PET-blue)
- GitHub Repo stars - VL--Adapter-blue)
- [Paper PDF
- GitHub Repo stars - Ladder%20Side--Tuning-blue)
- [Paper PDF - side-tuning) [[Semantic Scholar]](https://www.semanticscholar.org/paper/960d40497717ad22a7ebb84db238fa2415fc89cc)
- [Paper PDF
- GitHub Repo stars - VL--PET-blue)
- GitHub Repo stars - VL--Adapter-blue)
- [Paper PDF
- GitHub Repo stars - Ladder%20Side--Tuning-blue)
- [Paper PDF - side-tuning) [[Semantic Scholar]](https://www.semanticscholar.org/paper/960d40497717ad22a7ebb84db238fa2415fc89cc)
- [Paper PDF
- [Paper PDF - PET) [[Website]](https://henryhzy.github.io/VL-PET) [[Semantic Scholar]](https://www.semanticscholar.org/paper/80a791f644defb54f4eb24f99df31e6f995be3aa)
- [Paper PDF - PET) [[Website]](https://henryhzy.github.io/VL-PET) [[Semantic Scholar]](https://www.semanticscholar.org/paper/80a791f644defb54f4eb24f99df31e6f995be3aa)
- [Paper PDF
-
-
Acknowledgments
Programming Languages
Categories
Sub Categories