An open API service indexing awesome lists of open source software.

https://github.com/actualwitch/experiment

πŸ”¬ Experiment is a LLM chat UI with advanced tool use debugging facilities.
https://github.com/actualwitch/experiment

anthropic bun chat experiment-tracking inference isomorphic llm llm-inference openai react

Last synced: about 1 year ago
JSON representation

πŸ”¬ Experiment is a LLM chat UI with advanced tool use debugging facilities.

Awesome Lists containing this project

README

          




Experiment screenshot



Web

β–΄

macOS

β–΄

Linux

β–΄

Windows

# πŸ”¬ Let's start the Experiment

[![Tests](https://github.com/actualwitch/experiment/actions/workflows/test.yml/badge.svg)](https://github.com/actualwitch/experiment/actions/workflows/test.yml)

**Experiment** is a professional-grade chat interface for Large Language Models (LLMs) designed for developers, prompt engineers, and AI researchers. It provides a streamlined environment for working with Anthropic, OpenAI, and Mistral models, with powerful debugging tools for prompt engineering and tool integration.

## Features

- πŸ’¬ **Multi-Provider Support**: Connect to Anthropic, OpenAI, and Mistral APIs with a unified interface
- 🧰 **Advanced Tool Debugging**: Visualize and manage tool interactions with JSON schema visualization
- πŸ“‚ **Include Context**: Add a directory to experiment and share its text content with the model
- πŸ” **Prompt Engineering**: Easily create, test, and iterate on prompts with real-time feedback
- πŸ“Š **Import CSV**: Analyze previous completions from CSV files
- 🌐 **Universal Platform**: Available as both a web app and self-contained desktop application
- πŸ“± **Mobile Optimized**: Full-featured mobile version with Progressive Web App (PWA) support
- πŸ” **Secure by Design**: Store API tokens securely with optional 1Password integration (binary edition)
- πŸ–₯️ **OLED-Friendly**: Dark mode uses true black for energy efficiency on OLED displays
- 🍻 **Free as in MIT**: All code is open source and permissively licensed
- πŸ™Š **Privacy First**: Your data stays local with no telemetry or tracking

## Getting Started

Experiment is available in binary and non-binary editions. Binary edition requires no dependencies and includes additional features like 1Password integration for secure token storage.

### Non-binary edition (Web/SPA)

Try the web version instantly at [actualwitch.github.io/experiment](https://actualwitch.github.io/experiment/)

### Binary edition (macOS/Linux/Windows)

[Download](https://github.com/actualwitch/experiment/releases/latest) the latest release for your platform and run it.

> [!NOTE]
> macOS and Linux users need to make the downloaded file executable:
> ```shell
> chmod +x ./experiment-*
> ```
> macOS users also need to remove quarantine:
> ```shell
> xattr -d com.apple.quarantine ./experiment-*
> ```

## Tool Debugging

Experiment provides comprehensive visualization for LLM tool use. Add tools by pasting a JSON schema into chat in OpenAI and Anthropic formats. The schema will be visualized with properties sorted by name and depth for easy navigation. Click on property names to collapse sections.

Read more about tool debugging β†’

## Architecture

Experiment uses a custom architecture called "entangled atoms" which extends [jōtai](https://jotai.org/) to synchronize state across different JavaScript realms. This enables seamless state management between server and client.

Read more about the architecture β†’

## Development

```shell
# Start development server
bun dev

# Build binary edition
bun run build:bin

# Build static site
bun run build:ssg
```


Banner by Jess Bailey on Unsplash