https://github.com/lmg-anon/mikupad
LLM Frontend in a single html file
https://github.com/lmg-anon/mikupad
ai llm reactjs
Last synced: about 1 month ago
JSON representation
LLM Frontend in a single html file
- Host: GitHub
- URL: https://github.com/lmg-anon/mikupad
- Owner: lmg-anon
- License: cc0-1.0
- Created: 2023-10-04T17:27:12.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-01-15T15:03:14.000Z (4 months ago)
- Last Synced: 2025-01-15T16:27:35.563Z (4 months ago)
- Topics: ai, llm, reactjs
- Language: HTML
- Homepage: https://lmg-anon.github.io/mikupad/mikupad.html
- Size: 1.16 MB
- Stars: 300
- Watchers: 5
- Forks: 31
- Open Issues: 26
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-local-llms - mikupad
README
# mikupad
**mikupad** is a user-friendly, browser-based interface for interacting with language models. It's built with ReactJS and supports various text generation backends, all within a single HTML file.
## Features
* **Multiple Backends**: Supports **llama.cpp**, **koboldcpp**, **AI Horde**, and any **OpenAI Compatible** API.
* **Session Persistence**: Your prompt is automatically saved and restored, allowing you to continue seamlessly across multiple sessions. Import and export sessions for sharing or maintaining backups.
* **Optional Server**: Can be hosted on a local Node.js server, enabling database access remotely or across your local network.
* **Persistent Context**:
* **Memory**: Seamlessly inject a text of your choice at the beginning of the context.
* **Author's Note**: Seamlessly inject a text of your choice at the end of the context, with adjustable depth.
* **World Info**: Dynamically include extra information in the context, triggered by specific keywords.
* **Prediction Undo/Redo**: Easily experiment and refine your generated text with the ability to undo and redo predictions.
* **Token Probability**: Hover over any token to reveal the top 10 most probable tokens at that point. Click on a probability to regenerate the text from that specific token.
* If you're using oobabooga, make sure to use an \_HF sampler for this feature to function properly.
* If you're using koboldcpp, token probabilities are only available with Token Streaming disabled.
* **Logit Bias**: Fine-tune the generation process by adjusting the likelihood bias of specific tokens on-the-fly.
* **Completion/Chat Modes**:
* **Completion**: Have the language model directly continue your prompt.
* **Chat**: Mikupad simplifies using instruct models. It automatically adds the right delimiters when you start or stop generating, based on your selected template. This also structures your prompt into messages, making it compatible with the Chat Completions API (for OpenAI-compatible backends).
* **Themes**: Customize your environment by choosing from a variety of themes.
## Getting Started
You can easily run **mikupad** by opening the `mikupad.html` file in your web browser. No additional installation is required. Choose your preferred backend and start generating text!
```shell
git clone https://github.com/lmg-anon/mikupad.git
cd mikupad
open mikupad.html
```
To use **mikupad** fully offline, run the provided `compile` script or download the pre-compiled `mikupad_compiled.html` file from [Releases](https://github.com/lmg-anon/mikupad/releases/latest).
You can also [try it on GitHub Pages](https://lmg-anon.github.io/mikupad/mikupad.html).
## Contributing
Contributions from the open-source community are welcome. Whether it's fixing a bug, adding a feature, or improving the documentation, your contributions are greatly appreciated. To contribute to **mikupad**, follow these steps:
1. Fork the repository.
2. Create a new branch for your changes: `git checkout -b feature/your-feature-name`
3. Make your changes and commit them: `git commit -m 'Add your feature'`
4. Push your changes to your forked repository: `git push origin feature/your-feature-name`
5. Open a pull request on the main repository, explaining your changes.
## License
This project is released to the public domain under the CC0 License - see the [LICENSE](LICENSE) file for details.