https://github.com/microsoft/mup

maximal update parametrization (µP)
https://github.com/microsoft/mup

deep-learning machine-learning mup mutransfer python pytorch transformers

Last synced: about 2 months ago
JSON representation

maximal update parametrization (µP)

• Host: GitHub
• URL: https://github.com/microsoft/mup
• Owner: microsoft
• License: mit
• Created: 2021-11-02T20:36:26.000Z (almost 3 years ago)
• Default Branch: main
• Last Pushed: 2024-05-06T02:48:30.000Z (5 months ago)
• Last Synced: 2024-05-15T12:30:57.124Z (4 months ago)
• Topics: deep-learning, machine-learning, mup, mutransfer, python, pytorch, transformers
• Language: Jupyter Notebook
• Homepage: https://arxiv.org/abs/2203.03466
• Size: 16.7 MB
• Stars: 1,192
• Watchers: 29
• Forks: 86
• Open Issues: 24
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Security: SECURITY.md
  • Support: SUPPORT.md

Awesome Lists containing this project