https://github.com/saforem2/Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2
https://github.com/saforem2/Megatron-DeepSpeed

Last synced: 26 days ago
JSON representation

Ongoing research training transformer language models at scale, including: BERT & GPT-2

• Host: GitHub
• URL: https://github.com/saforem2/Megatron-DeepSpeed
• Owner: saforem2
• License: other
• Fork: true (microsoft/Megatron-DeepSpeed)
• Created: 2023-02-15T12:54:03.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-02-26T19:08:37.000Z (4 months ago)
• Last Synced: 2024-05-01T13:38:32.360Z (about 2 months ago)
• Language: Python
• Homepage:
• Size: 4.73 MB
• Stars: 4
• Watchers: 0
• Forks: 1
• Open Issues: 1

Lists

• awesome-stars - saforem2/Megatron-DeepSpeed - Ongoing research training transformer language models at scale, including: BERT & GPT-2 (Python)