https://github.com/wtlow003/ngram-decoding

(Re)-implementation of "Prompt Lookup Decoding" by Apoorv Saxena, with extended ideas from LLMA Decoding.

llm-inference n-gram ngram-decoding prompt-lookup-decoding speculative-decoding

Last synced: 21 Apr 2026