Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
1 "flash-decoding" Awesome Lists
Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
awesome-llm awq flash-attention flash-attention-2 flash-decoding inferflow kv-quant mamba paged-attention sora
1,183 stars
87 forks
176 projects
Last updated: 19 Apr 2024