Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/Akegarasu/ChatGLM-webui

A WebUI for ChatGLM-6B
https://github.com/Akegarasu/ChatGLM-webui

Last synced: about 2 months ago
JSON representation

A WebUI for ChatGLM-6B

Host: GitHub
URL: https://github.com/Akegarasu/ChatGLM-webui
Owner: Akegarasu
Created: 2023-03-14T11:38:56.000Z (almost 2 years ago)
Default Branch: main
Last Pushed: 2023-07-25T13:32:59.000Z (over 1 year ago)
Last Synced: 2024-10-10T16:23:50.136Z (2 months ago)
Language: Python
Size: 77.1 KB
Stars: 1,922
Watchers: 17
Forks: 256
Open Issues: 25
Metadata Files:
- Readme: README.md

Awesome Lists containing this project

awesome-open-chatgpt - Akegarasu/ChatGLM-webui
awesome-totally-open-chatgpt - Akegarasu/ChatGLM-webui

README

# ChatGLM-webui

A webui for ChatGLM made by THUDM. [chatglm-6b](https://huggingface.co/THUDM/chatglm-6b)

![image](https://user-images.githubusercontent.com/36563862/226985330-48e3b7f8-8c03-4778-af39-fd9b3a993d19.png)

## Features

- Original Chat like [chatglm-6b](https://huggingface.co/THUDM/chatglm-6b)'s demo, but use Gradio Chatbox for better user experience.
- One click install script (but you still must install python)
- More parameters that can be freely adjusted
- Convenient save/load dialog history, presets
- Custom maximum context length
- Save to Markdown
- Use program arguments to specify model and caculation accuracy

## Install

### requirements

python3.10

```shell
pip install torch==1.13.1+cu117 torchvision==0.14.1+cu117 --extra-index-url https://download.pytorch.org/whl/cu117
pip install --upgrade -r requirements.txt
```

```shell
bash install.sh
```

## Run

```shell
python webui.py
```

### Arguments

`--model-path`: specify model path. If this parameter is not specified manually, the default value is `THUDM/chatglm-6b`. Transformers will automatically download model from huggingface.

`--listen`: launch gradio with 0.0.0.0 as server name, allowing to respond to network requests

`--port`: webui port

`--share`: use gradio to share

`--precision`: fp32(CPU only), fp16, int4(CUDA GPU only), int8(CUDA GPU only)

`--cpu`: use cpu

`--path-prefix`: url root path. If this parameter is not specified manually, the default value is `/`. Using a path prefix of `/foo/bar` enables ChatGLM-webui to serve from `http://$ip:$port/foo/bar/` rather than `http://$ip:$port/`.