https://github.com/gurpreetkaurjethra/quantize-llm-using-awq

Quantize LLM using AWQ
https://github.com/gurpreetkaurjethra/quantize-llm-using-awq

awq generative-ai large-language-models llm-training llms quantize

Last synced: 7 months ago
JSON representation

Quantize LLM using AWQ

• Host: GitHub
• URL: https://github.com/gurpreetkaurjethra/quantize-llm-using-awq
• Owner: GURPREETKAURJETHRA
• Created: 2024-04-26T19:39:22.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-04-26T19:41:30.000Z (about 1 year ago)
• Last Synced: 2024-05-06T17:23:36.912Z (about 1 year ago)
• Topics: awq, generative-ai, large-language-models, llm-training, llms, quantize
• Language: Jupyter Notebook
• Homepage:
• Size: 49.8 KB
• Stars: 2
• Watchers: 1
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Quantize-LLM-using-AWQ

Quantize LLM using AWQ