Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/kevinknights29/llama-v2-chat-app
This project leverages Llama v2 Chat models for a Chatbot Application
https://github.com/kevinknights29/llama-v2-chat-app
chatbot llama llm
Last synced: 23 days ago
JSON representation
This project leverages Llama v2 Chat models for a Chatbot Application
- Host: GitHub
- URL: https://github.com/kevinknights29/llama-v2-chat-app
- Owner: kevinknights29
- License: mit
- Created: 2023-07-23T02:26:36.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-07-30T05:53:54.000Z (over 1 year ago)
- Last Synced: 2024-10-10T06:09:29.164Z (27 days ago)
- Topics: chatbot, llama, llm
- Language: Python
- Homepage:
- Size: 27.3 KB
- Stars: 0
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Llama-v2-Chat-App
This project leverages Llama v2 Chat models for a Chatbot Application
## Description
This project was inspired on: [The FASTEST way to build CHAT UI for LLAMA-v2](https://youtu.be/PE0DQlQItro?list=PL98nY_tJQXZlXLELjCMA8cciKLRE2eLME) by [Abhishek Thakur](https://gist.github.com/abhishekkrthakur)
This Chat Application include the following features:
- Llama.cpp.
- Memory.
- Inference API for Text Generation.
All in a containerized maner.
## Results
Chatbot:
API:
## Usage
### Build APP and API Images
```bash
docker compose build
```
### Get everything up and running
```bash
docker compose down && docker compose up -d
```
### Have fun
Visit: `http://localhost:7861/` to access the Gradio Chatbot UI.
To learn more about the inference API, please visit: `http://localhost:5001/swagger`
## Contributing
### Installing pre-commit
Pre-commit is already part of this project dependencies.
If you would like to installed it as standalone run:
```console
pip install pre-commit
```
To activate pre-commit run the following commands:
- Install Git hooks:
```console
pre-commit install
```
- Update current hooks:
```console
pre-commit autoupdate
```
To test your installation of pre-commit run:
```console
pre-commit run --all-files
```