https://github.com/mdegans/weave
https://github.com/mdegans/weave
Last synced: 3 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/mdegans/weave
- Owner: mdegans
- License: other
- Created: 2024-05-09T02:48:25.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-05-22T22:29:27.000Z (about 1 year ago)
- Last Synced: 2024-05-22T22:30:17.629Z (about 1 year ago)
- Language: Rust
- Size: 976 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
# `weave` multiversal writing tool
Weave is a "multiversal" generative tree writing tool akin to [`loom`](https://github.com/socketteer/loom). It supports multiple generative backends such as:
- ✅ [`drama_llama`](https://github.com/mdegans/drama_llama) - llama.cpp wrapper supporting all llama.cpp models
- ✅ OpenAI models
- ✅ Shim for GPT 3.5+ chat completions API, including GPT 4o.
- 🔲 Anthropic models (coming soon, using [`misanthropic`](https://docs.rs/misanthropic/latest/misanthropic/))
## Installation
- **Download** a release from the [releases page](https://github.com/mdegans/weave/releases) and extract it.
- For **macOS and Linux** installation will be straightforward with an `.app` and a Debian package containing a static binary.
- For Windows, a release is not yet provided but it will probably build for `openai` with `cargo build --release --features="openai,gui"`. LLaMA will require a bit more work to build on Windows.
## Usage
- [llama](resources/LLAMA_HELP.md)
- [openai](resources/OPENAI_HELP.md)
## Features
Notable features:
- **Live switching of backends** - Generate part of a story
with OpenAI and another part with LLaMA -- all without restarting the app.
- **Streaming responses** - Cancel generations in progress --
both local and online.
- **Live editing** - Edit posts during generation. New tokens are always appended to the end.
- **Advanced sampling controls** - For local language models. Use any sampling methods in any order.
Coming soon:
- Multiple tabs and windows
- Per-story settings
- Anthropic models
Additionally, one goal of `weave` is feature parity with [`loom`](https://github.com/socketteer/loom?tab=readme-ov-file#features).
- ☑️ Read mode
- ✅ Linear story view
- ✅ Tree nav bar
- 🔲 Edit mode
- ☑️ Tree view
- ✅ Explore tree visually with mouse
- ✅ Expand and collapse nodes
- ✅ Change tree topology
- ✅ Edit nodes in place
- 🔲 Navigation
- ✅ Hotkeys
- 🔲 Bookmarks
- 🔲 Chapters
- 🔲 'Visited' state
- ☑️ Generation
- 🔲 Generate N children with various models (currently one a time).
- ✅ Modify generation settings (Complete for OpenAI and mostly for local)
- ☑️ File I/O
- ✅ Serializable application state, including stories, to JSON.
- ✅ Open/save trees as JSON files
- 🔲 Work with trees in multiple tabs
- ✅ Combine multiple trees
# Notable issues
- This is **alpha software**. It may crash. It does auto-save, however you should
export your work to JSON if you care about it. It is not guaranteed to be
compatible with future versions, however we will try to maintain compatibility
as much as possible.
- With each new generation, all tokens need to be injested again with most
backends. This is solvable with `drama_llama` (longest prefix cache) but not
for the OpenAI API. So for OpenAI, it's recommended to generate larger posts.
The system prompt is customizable so you can tweak the agent's instructions on
verbosity. With Anthropic models, caching will be supported at user-defined
breakpoints.
- It is not currently possible to have a scrollable viewport so it's
recommended to collapse nodes if things get cluttered. This is because the
nodes are implemented with [`egui::containers::Window`](https://docs.rs/egui/latest/egui/containers/struct.Window.html) which ignore scrollable areas. This is fixable
but not easily and not cleanly. Zoom does work, however (Ctrl + + and Ctrl + -).