An open API service indexing awesome lists of open source software.

https://github.com/hadonis-testing/local-llm

A local LLM chatbot
https://github.com/hadonis-testing/local-llm

llm local-bot-api python python3

Last synced: 10 months ago
JSON representation

A local LLM chatbot

Awesome Lists containing this project

README

          

# Local LLM
![GitHub top language](https://img.shields.io/github/languages/top/hardingadonis/local-llm)
![GitHub repo size](https://img.shields.io/github/repo-size/hardingadonis/local-llm)
![GitHub License](https://img.shields.io/github/license/hardingadonis/local-llm)
> A local LLM chatbot

## Preview
Preview Image 1
Preview Image 2
Preview Image 3

## Requirements
- Python 3
- `virtualenv` package

## Installation
- Clone repository
```bash
git clone https://github.com/hardingadonis/local-llm.git
cd local-llm/
```

- Create virtual environment
```bash
virtualenv .venv
```

- Activate virtual environment
```bash
"./.venv/Scripts/activate"
```

- Install dependencies
```bash
pip install -r requirements.txt
```

- Download models
```bash
python server/download_models.py
```

- Run application
```bash
python server/run_server.py
```

## Notes:
- You can download other models. Just make sure to put them in the `server/models` directory.

## Contributors:



## Licenses:
- [Local LLM](https://github.com/hardingadonis/local-llm) is under the [MIT license](https://github.com/hardingadonis/local-llm/blob/main/LICENSE).