An open API service indexing awesome lists of open source software.

https://github.com/krisdigital/simple-ai-chat

Minimal chat bot interface to run with local LLMs
https://github.com/krisdigital/simple-ai-chat

ai chatbot lit-element llm ollama-api

Last synced: about 1 year ago
JSON representation

Minimal chat bot interface to run with local LLMs

Awesome Lists containing this project

README

          

# Simple Chat Bot

Lit powered experimental web component that streams from an openAI Api and formats the response with markdown.

![chat](https://github.com/user-attachments/assets/edcc9b22-1141-4f82-8e08-ace581eadf5c)

To check for yourself install Ollama and start it with the Phi3.5 model (`ollama run phi3.5`). Then run `npm ci`, run it with `npm run start:watch`!

You can pass the `endpoint` and the `model` (phi3.5) as attributes of the component in `index.html`