https://github.com/v-omelai/raspberry-llm-infra

This project is designed to deploy and run large language models (LLMs) on a Raspberry Pi.
https://github.com/v-omelai/raspberry-llm-infra

docker raspberry-pi terraform

Last synced: 3 months ago
JSON representation

This project is designed to deploy and run large language models (LLMs) on a Raspberry Pi.

• Host: GitHub
• URL: https://github.com/v-omelai/raspberry-llm-infra
• Owner: v-omelai
• License: mit
• Created: 2025-03-19T19:25:56.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2025-03-20T23:05:05.000Z (over 1 year ago)
• Last Synced: 2025-03-21T00:19:38.252Z (over 1 year ago)
• Topics: docker, raspberry-pi, terraform
• Language: HCL
• Homepage:
• Size: 3.91 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
## Overview

This project is designed to deploy and run **large language models (LLMs)** on a **Raspberry Pi**.

![Overview](overview.png)

## Commands

### Choco

- `choco install terraform`

### Terraform

> [!NOTE]  

> The `local-exec` provisioner commands are intended to run on Windows.

- `terraform fmt -recursive`

- `terraform -chdir=terraform init`

- `terraform -chdir=terraform plan`

- `terraform -chdir=terraform apply`

- `terraform -chdir=terraform destroy`

### SSH

- `ssh-keygen -t rsa -f .ssh/raspberry`

- `ssh -i .ssh/raspberry raspberry@raspberry`

### Open WebUI

- `powershell -ExecutionPolicy Bypass -File .\open-webui.ps1`