https://github.com/hao-ai-lab/LookaheadDecoding

[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
https://github.com/hao-ai-lab/LookaheadDecoding

Last synced: about 1 month ago
JSON representation

[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

• Host: GitHub
• URL: https://github.com/hao-ai-lab/LookaheadDecoding
• Owner: hao-ai-lab
• License: apache-2.0
• Created: 2023-11-21T17:36:43.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-10-14T05:39:51.000Z (2 months ago)
• Last Synced: 2024-11-05T03:51:35.174Z (about 2 months ago)
• Language: Python
• Homepage: https://arxiv.org/abs/2402.02057
• Size: 33.5 MB
• Stars: 1,140
• Watchers: 11
• Forks: 67
• Open Issues: 32
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• StarryDivineSky - hao-ai-lab/LookaheadDecoding