https://github.com/Infini-AI-Lab/MagicPIG

MagicPIG: LSH Sampling for Efficient LLM Generation
https://github.com/Infini-AI-Lab/MagicPIG

decoding gpu-cpu llm-inference lsh-algorithm

Last synced: 7 months ago
JSON representation

MagicPIG: LSH Sampling for Efficient LLM Generation

• Host: GitHub
• URL: https://github.com/Infini-AI-Lab/MagicPIG
• Owner: Infini-AI-Lab
• License: apache-2.0
• Created: 2024-10-21T20:57:26.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-10-24T09:31:12.000Z (over 1 year ago)
• Last Synced: 2024-10-25T07:09:31.741Z (over 1 year ago)
• Topics: decoding, gpu-cpu, llm-inference, lsh-algorithm
• Language: Python
• Homepage:
• Size: 54.3 MB
• Stars: 27
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• StarryDivineSky - Infini-AI-Lab/MagicPIG