https://github.com/oppiliappan/rt-bench

https://github.com/oppiliappan/rt-bench

Last synced: 2 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/oppiliappan/rt-bench
• Owner: oppiliappan
• Created: 2023-08-15T08:05:12.000Z (over 1 year ago)
• Default Branch: master
• Last Pushed: 2023-10-10T14:57:54.000Z (over 1 year ago)
• Last Synced: 2024-10-10T23:41:13.893Z (3 months ago)
• Language: Rust
• Size: 77.1 KB
• Stars: 2
• Watchers: 2
• Forks: 3
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md

Awesome Lists containing this project

README

        
# rt-bench

`rt-bench` contains benchmark code to compare the following ML frameworks:

- ggml

- ggml on gpu

- onnx

- candle

## Usage

Clone this repository with `git-lfs` installed:

```bash

git clone https://github.com/bloopai/rt-bench

```

This should download necessary model & tokenizer files. You can now run

benchmarks with:

```bash

cargo bench

```

The generated violin plots are stored under `target/criterion/embedding`.