https://github.com/cryscan/web-rwkv-realweb
https://github.com/cryscan/web-rwkv-realweb
Last synced: about 1 year ago
JSON representation
- Host: GitHub
- URL: https://github.com/cryscan/web-rwkv-realweb
- Owner: cryscan
- License: other
- Created: 2024-02-13T15:04:48.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2025-01-12T12:20:07.000Z (over 1 year ago)
- Last Synced: 2025-03-16T07:23:49.122Z (about 1 year ago)
- Language: Rust
- Size: 32.1 MB
- Stars: 32
- Watchers: 3
- Forks: 5
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Web-RWKV-RealWeb
Run the RWKV model locally in browser on your GPU. This demo is built upon the [web-rwkv](https://github.com/cryscan/web-rwkv) inference engine.
Check the [live demo](https://cryscan.github.io/web-rwkv-realweb/)!
## Development
### File structure
```bash
.
├── assets # static files
├── node_modules
├── src # ts code for web
├── index.html # web entry point
└── web-rwkv-realweb # rust code
└── src
```
### `rust` and `wasm-pack` setup
To install `wasm-pack`, use
```bash
cd web-rwkv-realweb
cargo install wasm-pack
```
### Project setup
We use [pnpm](https://pnpm.io) to manage the node packages. To install the project dependencies, use:
```bash
pnpm install
```
### Run & Build
To run the development server, use:
```bash
pnpm run dev
```
To build wasm package only, use:
```bash
pnpm run wasm:build
```
To build the project, use:
```bash
pnpm run build
pnpm run preview
```
## Available Models
You can find the available models on [cryscan's huggingface page](https://huggingface.co/cgisky).
The model files name should end in `.st`.