Projects in Awesome Lists by Infini-AI-Lab
A curated list of projects in awesome lists by Infini-AI-Lab .
https://github.com/Infini-AI-Lab/Sequoia
scalable and robust tree-based speculative decoding algorithm
efficiency inference llm speculative-decoding
Last synced: 16 Oct 2025
https://github.com/Infini-AI-Lab/TriForce
[COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
acceleration efficiency inference llm llm-inference long-context speculative-decoding
Last synced: 16 May 2025
https://github.com/Infini-AI-Lab/MagicPIG
MagicPIG: LSH Sampling for Efficient LLM Generation
decoding gpu-cpu llm-inference lsh-algorithm
Last synced: 24 Jul 2025