Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/NVIDIA/Megatron-LM
Ongoing research training transformer models at scale
https://github.com/NVIDIA/Megatron-LM
large-language-models model-para transformers
Last synced: about 2 months ago
JSON representation
Ongoing research training transformer models at scale
- Host: GitHub
- URL: https://github.com/NVIDIA/Megatron-LM
- Owner: NVIDIA
- License: other
- Created: 2019-03-21T16:15:52.000Z (over 5 years ago)
- Default Branch: main
- Last Pushed: 2024-05-20T08:21:00.000Z (4 months ago)
- Last Synced: 2024-05-22T01:11:52.406Z (4 months ago)
- Topics: large-language-models, model-para, transformers
- Language: Python
- Homepage: https://docs.nvidia.com/megatron-core/developer-guide/latest/user-guide/index.html#quick-start
- Size: 8.13 MB
- Stars: 8,839
- Watchers: 155
- Forks: 1,985
- Open Issues: 425
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Codeowners: CODEOWNERS
Awesome Lists containing this project
- awesome-local-ai - Megatron-LM - Ongoing research training transformer models at scale. (Training)
- awesome-bert - NVIDIA/Megatron-LM
- Awesome_Multimodel_LLM - Megatron-LM - Ongoing research training transformer models at scale. (LLM Training Frameworks)
- awesome-distributed-ml - Megatron-LM: Ongoing Research Training Transformer Models at Scale
- awesome-lm-system - Megatron-LM
- awesome-transformer-nlp - NVIDIA/Megatron-LM - Ongoing research training transformer language models at scale, including: BERT. (Transformer Implementations By Communities / PyTorch)
- awesome-repositories - NVIDIA/Megatron-LM - Ongoing research training transformer models at scale (Python)
- AiTreasureBox - NVIDIA/Megatron-LM - 09-13_9929_0](https://img.shields.io/github/stars/NVIDIA/Megatron-LM.svg)|Ongoing research training transformer models at scale| (Repos)
- StarryDivineSky - NVIDIA/Megatron-LM
- Awesome-LLM - Megatron-LM - Ongoing research training transformer models at scale. (LLM Training Frameworks)
- Awesome-LLM-Compression - [Code
- project-awesome - NVIDIA/Megatron-LM - Ongoing research training transformer models at scale (Python)
- awesome-production-machine-learning - Megatron-LM - LM.svg?style=social) - Megatron-LM is a highly optimized and efficient library for training large language models. (Industry Strength NLP)