https://github.com/aschaeffer/ollama-poc

POC: Run tinyllama in 15 minutes with Rust
https://github.com/aschaeffer/ollama-poc

ollama rust-lang tinyllama

Last synced: about 1 month ago
JSON representation

POC: Run tinyllama in 15 minutes with Rust

• Host: GitHub
• URL: https://github.com/aschaeffer/ollama-poc
• Owner: aschaeffer
• License: mit
• Created: 2024-12-29T22:55:43.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-12-29T23:57:03.000Z (over 1 year ago)
• Last Synced: 2025-02-14T00:08:27.215Z (over 1 year ago)
• Topics: ollama, rust-lang, tinyllama
• Language: Rust
• Homepage:
• Size: 4.88 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.md

Awesome Lists containing this project

README

          
# ollama-poc

## Install ollama

```shell

curl -fsSL https://ollama.com/install.sh | sh

```

## Install and run tinyllama model

```shell

ollama run tinyllama

```

## Run

```shell

cargo run

```

## Use a custom prompt and/or custom model

```shell

cargo run --release -- --model tinyllama --prompt "What is ollama?"

```