https://github.com/daquexian/rwkv-benchmark

https://github.com/daquexian/rwkv-benchmark

Last synced: 24 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/daquexian/rwkv-benchmark
• Owner: daquexian
• Created: 2023-08-13T07:31:37.000Z (over 1 year ago)
• Default Branch: master
• Last Pushed: 2023-08-13T09:07:17.000Z (over 1 year ago)
• Last Synced: 2024-12-09T13:58:44.291Z (about 1 month ago)
• Language: Python
• Size: 25.4 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
## Benchmark RWKV backends

It rents GPUs from vast.ai, so make sure you have the vast.ai command line tool installed.

Example:

```

python3 benchmark.py --model xxx.pth --verbose -n 1 --branch daquexian/test --log-dir log

```

### How to add a new backend

Please refer to `ChatRWKV` backend implementation in benchmark.py. Typically, a benchmark script (like benchmark_chatrwkv.py) is also needed.