https://github.com/christ-offer/fastapi-htmx-llm-playground

https://github.com/christ-offer/fastapi-htmx-llm-playground

Last synced: 20 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/christ-offer/fastapi-htmx-llm-playground
• Owner: christ-offer
• Created: 2023-07-22T11:55:20.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-09-09T19:16:08.000Z (over 1 year ago)
• Last Synced: 2023-09-09T19:28:29.324Z (over 1 year ago)
• Language: Python
• Size: 1.04 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# FastAPI / HTMX Chatbot

## Table of Contents

- [Description](#description)

- [Functions](#functions)

- [Usage](#usage)

- [Screenshots](#screenshots)

## Description

FastAPI/HTMX Chatbot, for deploying to [Deta Space](https://deta.space/)

* Requires usage of /commands to save on tokens from system messages and function params. /commands send the message to different agents based on the command with their specific system message and function params.

* The UI is regular HTML but with HTMX for the dynamic parts.

* Has both OpenAI and Anthropic models available

* Does _NOT_ have streamed responses, because it's a pain :D

## TODO

- [x] Add database for users and history (works on deta.space)

- [ ] Add user auth

- [ ] Add user preferences (api-keys, system messages, etc)

## Functions (most of these generally just work locally, not on deta space for now)

* /csv - csv handler

* /python - python interpreter

* /write - file writer chooses between `data/`, `data/code/` and `data/code/projects` depending on what it's asked to write

* /read - file reader

* /edit - file editor (takes line range, text)

* /wikidata - wikidata sparql handler

* /scrape - web scraper 

* /claude - Use anthropics model (100k token window)

### Coding Assistant commands

These are not functions per se, they run a model with a specific system message for each that returns a response in a strict format. See `system.py` for the system messages. Also, screenshots.

* /review - performs a review of the code following a strict response format

* /brainstorm [n] - returns a list of n ideas for the topic following a strict response format

* /write_spec - Writes a spec for the brainstorm following a strict response format

* /ticket - creates a ticket for the brainstorm/spec following a strict response format

* /write_tests - writes tests for the ticket / file from ticket

* /write_code - writes code for a file from ticket

* /write_files - writes all the files/subfolders from the ticket/spec into the projects folder.

Example Usecase: /read_file code.ts/py/rs/etc -> /review -> /edit_file code.ts/py/rs/etc

## Usage

### Only local:

* Create a .env file in the root of the project:

  - OPENAI_API_KEY=your-api-key

  - ANTHROPIC_API_KEY=your-api-key

* `pip install -r requirements.txt` to install dependencies

* `python main.py` to run the chatbot

### Deta.space

[Read the docs](https://deta.space/docs/en)

## Screenshots

### Chat UI

![Code Review](screenshots/review.png)