https://github.com/tloen/llama-int8

Quantized inference code for LLaMA models
https://github.com/tloen/llama-int8

Last synced: about 1 month ago
JSON representation

Quantized inference code for LLaMA models

• Host: GitHub
• URL: https://github.com/tloen/llama-int8
• Owner: tloen
• License: gpl-3.0
• Fork: true (meta-llama/llama)
• Created: 2023-03-03T20:19:28.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2023-03-17T03:20:17.000Z (about 2 years ago)
• Last Synced: 2024-08-02T01:24:30.771Z (10 months ago)
• Language: Python
• Homepage:
• Size: 50.8 KB
• Stars: 1,052
• Watchers: 17
• Forks: 105
• Open Issues: 16

Awesome Lists containing this project

• awesome-ChatGPT-repositories - llama-int8 - Quantized inference code for LLaMA models (Langchain)