https://github.com/saforem2/Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2
https://github.com/saforem2/Megatron-DeepSpeed

Last synced: 14 days ago
JSON representation

Ongoing research training transformer language models at scale, including: BERT & GPT-2

• Host: GitHub
• URL: https://github.com/saforem2/Megatron-DeepSpeed
• Owner: saforem2
• License: other
• Fork: true (microsoft/Megatron-DeepSpeed)
• Created: 2023-02-15T12:54:03.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-02-26T19:08:37.000Z (9 months ago)
• Last Synced: 2024-08-01T16:52:48.074Z (3 months ago)
• Language: Python
• Homepage:
• Size: 4.73 MB
• Stars: 4
• Watchers: 0
• Forks: 0
• Open Issues: 1

Awesome Lists containing this project