https://github.com/haormj/llama2.go

Inference Llama 2 in one file of pure go
https://github.com/haormj/llama2.go

inference large-language-models llama llama2 llm

Last synced: 5 months ago
JSON representation

Inference Llama 2 in one file of pure go

• Host: GitHub
• URL: https://github.com/haormj/llama2.go
• Owner: haormj
• License: mit
• Created: 2023-07-25T06:23:26.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2023-07-25T13:38:41.000Z (almost 2 years ago)
• Last Synced: 2024-11-14T04:45:02.036Z (7 months ago)
• Topics: inference, large-language-models, llama, llama2, llm
• Language: Go
• Homepage:
• Size: 7.81 KB
• Stars: 16
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# llama2.go

ref [llama2.c](https://github.com/karpathy/llama2.c), golang version

## Usage

```bash

make

# download model.bin and tokenizer.bin to _output from https://github.com/karpathy/llama2.c

cd _output

./llama2 run

```