https://github.com/wangzhaode/mnn-llm

llm deploy project based mnn.
https://github.com/wangzhaode/mnn-llm

baichuan2-7b chatglm-6b chatglm2-6b codegeex2-6b cpp cuda mnn opencl qwen-7b

Last synced: about 1 month ago
JSON representation

llm deploy project based mnn.

• Host: GitHub
• URL: https://github.com/wangzhaode/mnn-llm
• Owner: wangzhaode
• License: apache-2.0
• Created: 2023-03-17T10:26:09.000Z (over 1 year ago)
• Default Branch: master
• Last Pushed: 2024-03-30T08:14:23.000Z (5 months ago)
• Last Synced: 2024-04-10T02:08:29.687Z (5 months ago)
• Topics: baichuan2-7b, chatglm-6b, chatglm2-6b, codegeex2-6b, cpp, cuda, mnn, opencl, qwen-7b
• Language: C++
• Homepage:
• Size: 10.5 MB
• Stars: 1,278
• Watchers: 26
• Forks: 144
• Open Issues: 12
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome_open_llms - glm6b-c++ mnn onnx