https://github.com/kuangjux/llama2-rs

llama2-rs is an attempt to perform inference on the llama-2 model using the Rust programming language.
https://github.com/kuangjux/llama2-rs

Last synced: about 2 months ago
JSON representation

llama2-rs is an attempt to perform inference on the llama-2 model using the Rust programming language.

• Host: GitHub
• URL: https://github.com/kuangjux/llama2-rs
• Owner: KuangjuX
• License: mit
• Created: 2024-01-11T13:53:20.000Z (12 months ago)
• Default Branch: main
• Last Pushed: 2024-01-15T11:32:36.000Z (12 months ago)
• Last Synced: 2024-10-12T21:18:01.219Z (3 months ago)
• Language: Rust
• Size: 13.7 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# llama2-rs

llama2-rs is an attempt to perform inference on the llama-2 model using the Rust programming language.

## Usage

```

wget https://huggingface.co/karpathy/tinyllamas/resolve/main/stories15M.bin

wget https://raw.githubusercontent.com/karpathy/llama2.c/master/tokenizer.bin

```