https://github.com/hizkifw/webchatrwkvstic
ChatGPT-like Web UI for RWKVstic
https://github.com/hizkifw/webchatrwkvstic
rwkv
Last synced: 3 months ago
JSON representation
ChatGPT-like Web UI for RWKVstic
- Host: GitHub
- URL: https://github.com/hizkifw/webchatrwkvstic
- Owner: hizkifw
- Archived: true
- Created: 2023-02-15T15:58:35.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2023-04-18T09:40:06.000Z (over 2 years ago)
- Last Synced: 2025-03-27T11:18:59.018Z (7 months ago)
- Topics: rwkv
- Language: Python
- Homepage:
- Size: 44.9 KB
- Stars: 100
- Watchers: 3
- Forks: 8
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# ! NO LONGER MAINTAINED !
> **Warning**
> This repository is no longer maintained. Please see other forks,
> such as [wfox4/WebChatRWKVv2](https://github.com/wfox4/WebChatRWKVv2). For
> more info on the RWKV language model, check the
> [BlinkDL/ChatRWKV](https://github.com/BlinkDL/ChatRWKV) repository.
---
# WebChatRWKVstic
[RWKV-V4](https://github.com/BlinkDL/RWKV-LM) inference via
[rwkvstic](https://github.com/harrisonvanderbyl/rwkvstic), with a ChatGPT-like
web UI, including real-time response streaming.
## How to use
```sh
# Clone this repository
git clone https://github.com/hizkifw/WebChatRWKVstic.git
cd WebChatRWKVstic
# Recommended: set up a virtual environment
python -m venv venv
source ./venv/bin/activate
# Install requirements
pip install -r requirements.txt
# Run the webserver
python main.py
```
The script will automatically download a suitable RWKV model into the `models`
folder. If you already have a model, you can create the `models` directory and
place your `.pth` file there.
## Currently state
- Mobile-friendly web UI with autoscroll, response streaming, markdown
formatting, and syntax highlighting
- Input is formatted into a question/answer format for the model, and earlier
chat messages are included in the context
## TODO
- Tune the model to better match ChatGPT
- Clean up the code
- Create a Docker image