https://github.com/internlm/awesome-llm-training-system

https://github.com/internlm/awesome-llm-training-system

List: awesome-llm-training-system

Last synced: 2 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/internlm/awesome-llm-training-system
• Owner: InternLM
• Created: 2024-07-29T06:29:39.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-08-06T04:41:03.000Z (over 1 year ago)
• Last Synced: 2026-02-19T15:34:34.722Z (2 months ago)
• Size: 61.5 KB
• Stars: 48
• Watchers: 5
• Forks: 13
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Awesome-LLM-Training-System

[![Maintenance](https://img.shields.io/badge/Maintained%3F-YES-green.svg)](https://github.com/InternLM/Awesome-LLM-Training-System/graphs/commit-activity)

[![Commit Activity](https://img.shields.io/github/commit-activity/m/InternLM/Awesome-LLM-Training-System.svg?color=red)](https://github.com/InternLM/Awesome-LLM-Training-System/graphs/commit-activity)

[![Last Commit](https://img.shields.io/github/last-commit/InternLM/Awesome-LLM-Training-System.svg)](https://github.com/InternLM/Awesome-LLM-Training-System/commits/master)

[![Awesome](https://awesome.re/badge.svg)](https://awesome.re)

[![GitHub stars](https://img.shields.io/github/stars/InternLM/Awesome-LLM-Training-System.svg?style=social)](https://GitHub.com/InternLM/Awesome-LLM-Training-System/stargazers/)

# Awesome LLM Training System

This repo displays a survey about optimizations for LLM training system. Relative papers about optimizing LLM training are categorized and listed below.

- [Infrastructure](Infrastructure.md#Infrastructure)

- [Parallelism Schemes](Parallelism_Schemes.md#Parallelism-Schemes)

- [Computation Optimizations](Computation_Optimizations.md#Computation-Optimization)

- [Memory Optimizations](Memory_Optimizations.md#Memory-Optimizations)

- [Communication Optimizations](Communication_Optimizations.md#Communication-Optimization)

- [Fault Tolerance](Fault_Tolerance.md#Fault-Tolerance)