https://github.com/datawhalechina/diy-llm
🎓 系统性大语言模型构建课程｜🛠️ 覆盖预训练数据工程、Tokenizer、Transformer、MoE、GPU 编程 (CUDA/Triton)、分布式训练、Scaling Laws、推理优化及对齐 (SFT/RLHF/GRPO)｜🚀 6 个渐进式作业 + 代码驱动，建立 LLM 全栈认知体系
https://github.com/datawhalechina/diy-llm
gpu-programming llm nlp rl sft transformer triton
Last synced: 14 days ago
JSON representation
🎓 系统性大语言模型构建课程｜🛠️ 覆盖预训练数据工程、Tokenizer、Transformer、MoE、GPU 编程 (CUDA/Triton)、分布式训练、Scaling Laws、推理优化及对齐 (SFT/RLHF/GRPO)｜🚀 6 个渐进式作业 + 代码驱动，建立 LLM 全栈认知体系
- Host: GitHub
- URL: https://github.com/datawhalechina/diy-llm
- Owner: datawhalechina
- Created: 2025-11-24T02:51:46.000Z (8 months ago)
- Default Branch: main
- Last Pushed: 2026-06-06T11:32:11.000Z (about 2 months ago)
- Last Synced: 2026-06-06T13:11:58.796Z (about 2 months ago)
- Topics: gpu-programming, llm, nlp, rl, sft, transformer, triton
- Language: Jupyter Notebook
- Homepage: https://datawhalechina.github.io/diy-llm/
- Size: 173 MB
- Stars: 871
- Watchers: 2
- Forks: 92
- Open Issues: 0
-
Metadata Files:
- Readme: README.md