https://github.com/huggingface/llm_training_handbook
An open collection of methodologies to help with successful training of large language models.
https://github.com/huggingface/llm_training_handbook
cuda large-language-models llm nccl nlp performance python pytorch scalability troubleshooting
Last synced: 8 months ago
JSON representation
An open collection of methodologies to help with successful training of large language models.
- Host: GitHub
- URL: https://github.com/huggingface/llm_training_handbook
- Owner: huggingface
- License: cc-by-sa-4.0
- Created: 2023-03-08T17:52:50.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2024-02-15T05:44:57.000Z (over 2 years ago)
- Last Synced: 2025-09-30T18:02:29.330Z (8 months ago)
- Topics: cuda, large-language-models, llm, nccl, nlp, performance, python, pytorch, scalability, troubleshooting
- Language: Python
- Homepage:
- Size: 167 KB
- Stars: 511
- Watchers: 50
- Forks: 43
- Open Issues: 1