https://github.com/RWKV/rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
https://github.com/RWKV/rwkv.cpp

deep-learning ggml language-model llm machine-learning quantization rwkv

Last synced: 7 days ago
JSON representation

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

• Host: GitHub
• URL: https://github.com/RWKV/rwkv.cpp
• Owner: RWKV
• License: mit
• Created: 2023-03-30T13:26:47.000Z (over 1 year ago)
• Default Branch: master
• Last Pushed: 2024-08-07T07:10:59.000Z (3 months ago)
• Last Synced: 2024-11-05T08:36:10.006Z (10 days ago)
• Topics: deep-learning, ggml, language-model, llm, machine-learning, quantization, rwkv
• Language: C++
• Homepage:
• Size: 38.1 MB
• Stars: 1,420
• Watchers: 22
• Forks: 98
• Open Issues: 30
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project