https://github.com/LiyuanLucasLiu/Transformer-Clinic

Understanding the Difficulty of Training Transformers
https://github.com/LiyuanLucasLiu/Transformer-Clinic

initialization nmt transformer wmt

Last synced: 3 months ago
JSON representation

Understanding the Difficulty of Training Transformers

• Host: GitHub
• URL: https://github.com/LiyuanLucasLiu/Transformer-Clinic
• Owner: LiyuanLucasLiu
• License: apache-2.0
• Created: 2020-04-01T16:24:54.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2022-05-31T18:27:35.000Z (over 2 years ago)
• Last Synced: 2024-04-20T17:00:21.603Z (7 months ago)
• Topics: initialization, nmt, transformer, wmt
• Language: Python
• Homepage: https://arxiv.org/abs/2004.08249
• Size: 5.15 MB
• Stars: 322
• Watchers: 12
• Forks: 19
• Open Issues: 1

Awesome Lists containing this project