https://github.com/drewxs/chatbot
AI chatbot using Llama 2
https://github.com/drewxs/chatbot
ai chatbot llama2
Last synced: about 2 months ago
JSON representation
AI chatbot using Llama 2
- Host: GitHub
- URL: https://github.com/drewxs/chatbot
- Owner: drewxs
- License: mit
- Created: 2023-08-29T13:07:38.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2023-08-30T06:17:26.000Z (almost 3 years ago)
- Last Synced: 2025-04-01T10:26:31.698Z (over 1 year ago)
- Topics: ai, chatbot, llama2
- Language: Rust
- Homepage:
- Size: 36.1 KB
- Stars: 2
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Chatbot
An AI chatbot built using Leptos, Actix, and Rustformers w/ Llama 2.
## Requirements
- Nightly Rust toolchain
- `wasm32-unknown-unknown` target
- Trunk and cargo-leptos tools
```sh
rustup toolchain install nightly
rustup target add wasm32-unknown-unknown
cargo install trunk cargo-leptos
```
## Setup
### Model
A downloaded model in GGML format supported by [Rustformers/llm](https://github.com/rustformers/llm).
Find one [here](https://huggingface.co/models?search=ggml).
Copy env template:
```sh
cp .env.example .env
```
Update `MODEL_PATH` with the full path to the downloaded model.
## Development
Launch development server:
```sh
cargo leptos watch
```