https://github.com/Jittor/JittorLLMs

计图大模型推理库，具有高性能、配置要求低、中文支持好、可移植等特点
https://github.com/Jittor/JittorLLMs

Last synced: about 2 months ago
JSON representation

计图大模型推理库，具有高性能、配置要求低、中文支持好、可移植等特点

• Host: GitHub
• URL: https://github.com/Jittor/JittorLLMs
• Owner: Jittor
• License: apache-2.0
• Created: 2023-04-02T06:22:01.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-01-06T17:24:16.000Z (12 months ago)
• Last Synced: 2024-10-15T09:41:40.843Z (2 months ago)
• Language: Python
• Size: 38.7 MB
• Stars: 2,363
• Watchers: 28
• Forks: 182
• Open Issues: 143
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• StarryDivineSky - Jittor/JittorLLMs - 6B)、鹏程[盘古大模型](https://openi.org.cn/pangu/)、BlinkDL的[ChatRWKV](https://github.com/BlinkDL/ChatRWKV)、国外Meta的[LLaMA大模型](https://github.com/facebookresearch/llama)等；可移植：用户不需要修改任何代码，只需要安装Jittor版torch(JTorch)；速度快：大模型加载速度慢，Jittor框架通过零拷贝技术，大模型加载开销降低40%，同时，通过元算子自动编译优化，计算性能相比同类框架提升20%以上。 (A01_文本生成_文本对话 / 大语言对话模型及数据)