Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/clairefro/llm-in-a-box


https://github.com/clairefro/llm-in-a-box

Last synced: 29 days ago
JSON representation

Awesome Lists containing this project

README

        

# LLM-in-a-box

Host a local LLM accessible on any device on your local network, with 100% local models and Ollama

## Installation

TODO: Ollama setup

1. Clone the repo

```bash
git clone
cd my_flask_app
```

2. Create a virtual environment (optional but recommended)

```bash
python3 -m venv venv
source venv/bin/activate # On Windows use `venv\Scripts\activate`
```

3.Install dependencies

```bash
pip3 install -r requirements.txt
```

4. Run

```bash
python app.py

```

## Interface

TODO