https://github.com/DocShotgun/ds-llm-webui

A simple tool-use assistant for local LLMs powered by TabbyAPI
https://github.com/DocShotgun/ds-llm-webui

Last synced: 3 days ago
JSON representation

A simple tool-use assistant for local LLMs powered by TabbyAPI

• Host: GitHub
• URL: https://github.com/DocShotgun/ds-llm-webui
• Owner: DocShotgun
• Created: 2024-04-15T15:59:25.000Z (9 months ago)
• Default Branch: main
• Last Pushed: 2024-06-13T03:28:14.000Z (7 months ago)
• Last Synced: 2024-06-13T07:17:27.353Z (7 months ago)
• Language: TypeScript
• Size: 261 KB
• Stars: 5
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome_ai_agents - Ds-Llm-Webui - A simple tool-use assistant for local LLMs powered by TabbyAPI (Building / Tools)
• awesome_ai_agents - Ds-Llm-Webui - A simple tool-use assistant for local LLMs powered by TabbyAPI (Building / Tools)

README

        
## ds-llm-webui

A simple tool-use assistant for local LLMs powered by TabbyAPI. This should be considered heavily WIP and not intended for end-user usage at the moment, however it does have the following features:

- Converse with an AI assistant via the chat completions endpoint of [TabbyAPI](https://github.com/theroyallab/tabbyAPI), with a single persistent chat history and limited sampling options

- Function calling framework via constrained generation using JSON schema

- Internet search using DuckDuckGo for search-augmented generation

- Extract the text content of a webpage for augmented generation

- Search a configured set of RSS feeds for updated news (URLs must be provided in config.json as an array of strings)

- Use the Wolfram Alpha LLM API for relevant queries

- Search PubMed via the NCBI E-utilities API for relevant queries

Mileage may vary depending on the capabilities of the LLM itself. Intended to be used with [CohereForAI/c4ai-command-r-plus](https://huggingface.co/CohereForAI/c4ai-command-r-plus). Make a copy of `userdata/config.example.json` and rename it to `config.json`.

This is a [Next.js](https://nextjs.org/) project using components from [shadcn/ui](https://ui.shadcn.com/). 

To run the development server:

```bash

npm run dev

# or

yarn dev

# or

pnpm dev

# or

bun dev

```

Open [http://localhost:3000](http://localhost:3000) with your browser.