Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Awesome-LLM-System-Papers

https://github.com/AmadeusChan/Awesome-LLM-System-Papers

Last synced: about 9 hours ago
JSON representation

LLM Training Systems
- Single-GPU Systems
- Distributed Systems
Algorithm-System Co-Design
LLM Inference (Serving) Systems
On-device LLM Inference (Serving) Systems
- Profiling and Benchmark Systems
General MLSys-Related Techniques (Incomplete)
- Distributed Systems
LLM Algorithm Papers Recommended for System Researchers
- Distributed Systems
Survyes
- Distributed Systems
Awesome Open-Sourced LLMSys Projects
- Distributed Systems
  - vLLM
  - llama.cpp
  - DeepSpeed
  - Megatron-LM
  - SGLang
  - TensorRT-LLM
  - MLC-LLM
  - vLLM
  - llama.cpp
  - DeepSpeed
  - Megatron-LM
  - SGLang
  - TensorRT-LLM
  - MLC-LLM
Other Useful Resources
- Distributed Systems

Programming Languages

Categories

LLM Inference (Serving) Systems 69 LLM Algorithm Papers Recommended for System Researchers 62 LLM Training Systems 53 General MLSys-Related Techniques (Incomplete) 20 Awesome Open-Sourced LLMSys Projects 14 On-device LLM Inference (Serving) Systems 12 Survyes 8 Other Useful Resources 8 Algorithm-System Co-Design 6

Sub Categories

Distributed Systems 156 Single-GPU Systems 9 Profiling and Benchmark Systems 6

Keywords

inference 4 llama 4 llm 4 pytorch 4 xpu 2 transformer 2 trainium 2 tpu 2 rocm 2 model-serving 2 mlops 2 llmops 2 llm-serving 2 inferentia 2 hpu 2 gpt 2 cuda 2 amd 2 tvm 2 machine-learning-compilation 2 language-model 2 transformers 2 model-para 2 large-language-models 2 zero 2 trillion-parameters 2 pipeline-parallelism 2 model-parallelism 2 mixture-of-experts 2 machine-learning 2 gpu 2 deep-learning 2 data-parallelism 2 compression 2 billion-parameters 2 ggml 2