https://github.com/RWKV/rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
https://github.com/RWKV/rwkv.cpp

deep-learning ggml language-model llm machine-learning quantization rwkv

Last synced: about 2 months ago
JSON representation

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

• Host: GitHub
• URL: https://github.com/RWKV/rwkv.cpp
• Owner: RWKV
• License: mit
• Created: 2023-03-30T13:26:47.000Z (over 1 year ago)
• Default Branch: master
• Last Pushed: 2024-04-16T10:49:40.000Z (5 months ago)
• Last Synced: 2024-05-22T04:19:04.612Z (4 months ago)
• Topics: deep-learning, ggml, language-model, llm, machine-learning, quantization, rwkv
• Language: C++
• Homepage:
• Size: 16.5 MB
• Stars: 1,112
• Watchers: 22
• Forks: 76
• Open Issues: 29
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project