https://github.com/SafeAILab/EAGLE

Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)
https://github.com/SafeAILab/EAGLE

large-language-models llm-inference speculative-decoding

Last synced: 11 days ago
JSON representation

Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)

• Host: GitHub
• URL: https://github.com/SafeAILab/EAGLE
• Owner: SafeAILab
• License: apache-2.0
• Created: 2023-12-07T19:08:39.000Z (11 months ago)
• Default Branch: main
• Last Pushed: 2024-09-27T22:30:59.000Z (about 1 month ago)
• Last Synced: 2024-09-28T16:47:34.015Z (about 1 month ago)
• Topics: large-language-models, llm-inference, speculative-decoding
• Language: Python
• Homepage: https://arxiv.org/pdf/2406.16858
• Size: 55.2 MB
• Stars: 776
• Watchers: 11
• Forks: 78
• Open Issues: 29
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-adaptive-computation - PyTorch code