Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/mmo80/alpaca-webui
Web UI for Ollama, OpenAI, Together.ai, Mistral.ai, Groq.com
https://github.com/mmo80/alpaca-webui
Last synced: about 2 months ago
JSON representation
Web UI for Ollama, OpenAI, Together.ai, Mistral.ai, Groq.com
- Host: GitHub
- URL: https://github.com/mmo80/alpaca-webui
- Owner: mmo80
- License: mit
- Created: 2024-02-18T01:14:55.000Z (10 months ago)
- Default Branch: main
- Last Pushed: 2024-04-14T09:47:09.000Z (8 months ago)
- Last Synced: 2024-04-14T11:47:36.556Z (8 months ago)
- Language: TypeScript
- Homepage:
- Size: 1.09 MB
- Stars: 3
- Watchers: 1
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- Awesome-Ollama - Alpaca WebUI
README
# Alpaca WebUI
Alpaca WebUI, initially crafted for [Ollama](https://ollama.com/), is a chat conversation interface featuring markup formatting and code syntax highlighting. It supports a variety of LLM endpoints through the OpenAI Chat Completions API and now includes a RAG (Retrieval-Augmented Generation) feature, allowing users to engage in conversations with information pulled from uploaded documents.
The app lets you easily try out different AI models from various services to find answers using your documents. It simplifies mixing and matching these models to see which one works best for your needs.
 
**Has**
- [x] Support for your local or remote [Ollama](https://ollama.com/) server
- [x] Compatible with OpenAI Chat Completions API
- [x] Works with [OpenAI](https://chat.openai.com/), [Together.ai](https://www.together.ai/products#inference), [Mistral.ai](https://mistral.ai/), [Groq.com](https://wow.groq.com/) and [Ollama](https://ollama.com/)
- [x] Upload document (pdf, txt, docx) for RAG usage
- [x] Modify System Prompt for Chat and RAG
- [x] Markup Formatting
- [x] Code Syntax Highlighting
- [x] List available models for services supporting OpenAI API model endpoint (and listing of Ollama models)
- [x] Mobile-Friendly and Desktop-Friendly Layout
- [x] Generate images with OpenAI dall-e-3 and dall-e-2 models _(write **/image** followed by prompt in chat)_
**Pending Implementation**
- Modify Parameters (like temperature, mirostat ...)
- Attach ImageFile
- Chat History
**Env**
This is a [Next.js](https://nextjs.org/) project bootstrapped with [`create-next-app`](https://github.com/vercel/next.js/tree/canary/packages/create-next-app).
## Getting Started
#### Run the development server:
1. `git clone https://github.com/mmo80/alpaca-webui.git`
2. Setup and install your [Weaviate database](https://weaviate.io/developers/weaviate/installation) or just use the docker-compose weaviate file in the repository with the following command `docker-compose -f docker-compose.weaviate.yaml up --build --detach`.
3. Check the environment variables in `.env.development`
4. Then just run `npm install` followed by `npm run dev` :sunglasses:
Open [http://localhost:3000](http://localhost:3000) with your browser to start using the app.
#### Docker Compose
This command sets up two containers: one for the app and another for the [Weaviate](https://weaviate.io/) vector database. (Please note that there is no data persistence on a mapped volume in this configuration.)
```shell
docker compose up --detach
```
Then Open [http://localhost:3033](http://localhost:3033) with your browser to start using the app.
The official [Alpaca WebUI Docker Image](https://hub.docker.com/r/forloopse/alpaca-webui) `forloopse/alpaca-webui` is available on Docker Hub.
## YouTube Overview
[](https://www.youtube.com/watch?v=utacKYiHtwI 'Alpaca WebUI Demo, AI, LLM, RAG, Web UI for Ollama, OpenAI, Together.xyz, Mistral.ai, Groq.com')