https://github.com/csg2008/internlm2_lmdeploy_demo
书生浦语 LMDeploy 部署实验
https://github.com/csg2008/internlm2_lmdeploy_demo
internlm2 lmdeploy
Last synced: 3 months ago
JSON representation
书生浦语 LMDeploy 部署实验
- Host: GitHub
- URL: https://github.com/csg2008/internlm2_lmdeploy_demo
- Owner: csg2008
- Created: 2024-04-21T06:52:53.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-04-25T11:31:39.000Z (about 1 year ago)
- Last Synced: 2025-01-31T04:03:30.053Z (4 months ago)
- Topics: internlm2, lmdeploy
- Language: Python
- Homepage:
- Size: 2.93 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
Awesome Lists containing this project
README
# 书生浦语大模型 LMDeploy Web 部署实验
本实验是学习使用 LMDeploy 部署模型，并通过 Web 界面方式向外提供服务。
相关资源：
> - [LMDeploy](https://github.com/InternLM/lmdeploy): LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
> - [internlm2-chat-1-8b](https://openxlab.org.cn/models/detail/OpenLMLab/internlm2-chat-1.8b): 书生·浦语-1.8B (InternLM2-1.8B) 是第二代浦语模型系列的18亿参数版本
> - [课程链接](https://github.com/InternLM/Tutorial/tree/camp2/lmdeploy): LMDeploy 量化部署 LLM & VLM 实践
> - [学习笔记](https://github.com/csg2008/InternLMAgricultureAssistant/blob/main/note/lesson5.md): LMDeploy 量化部署 LLM & VLM 实践