https://github.com/hadonis-testing/local-llm
A local LLM chatbot
https://github.com/hadonis-testing/local-llm
llm local-bot-api python python3
Last synced: 10 months ago
JSON representation
A local LLM chatbot
- Host: GitHub
- URL: https://github.com/hadonis-testing/local-llm
- Owner: hadonis-testing
- License: mit
- Archived: true
- Created: 2023-11-30T04:38:23.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2023-11-30T15:56:15.000Z (over 2 years ago)
- Last Synced: 2025-03-31T04:39:26.765Z (about 1 year ago)
- Topics: llm, local-bot-api, python, python3
- Language: Python
- Homepage:
- Size: 170 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Local LLM



> A local LLM chatbot
## Preview

## Requirements
- Python 3
- `virtualenv` package
## Installation
- Clone repository
```bash
git clone https://github.com/hardingadonis/local-llm.git
cd local-llm/
```
- Create virtual environment
```bash
virtualenv .venv
```
- Activate virtual environment
```bash
"./.venv/Scripts/activate"
```
- Install dependencies
```bash
pip install -r requirements.txt
```
- Download models
```bash
python server/download_models.py
```
- Run application
```bash
python server/run_server.py
```
## Notes:
- You can download other models. Just make sure to put them in the `server/models` directory.
## Contributors:
## Licenses:
- [Local LLM](https://github.com/hardingadonis/local-llm) is under the [MIT license](https://github.com/hardingadonis/local-llm/blob/main/LICENSE).