An open API service indexing awesome lists of open source software.

https://github.com/atomiechen/handyllm

A handy toolkit for using LLM.
https://github.com/atomiechen/handyllm

Last synced: about 1 year ago
JSON representation

A handy toolkit for using LLM.

Awesome Lists containing this project

README

          




🌟 Support us! If you find HandyLLM useful, please consider starring it to help it spread and improve 🌟



# HandyLLM

[![GitHub](https://img.shields.io/badge/github-HandyLLM-blue?logo=github)][0]
[![PyPI](https://img.shields.io/pypi/v/HandyLLM?logo=pypi&logoColor=white&color=brown)][1]
[![vsmarketplace](https://vsmarketplacebadges.dev/version-short/atomiechen.handyllm.svg)][2]
[![sublimepackage](https://img.shields.io/github/v/tag/atomiechen/Sublime-HandyLLM?logo=sublimetext&label=ST%20Package)][3]

A handy toolkit for using LLM, with both ***development support ([Python][1])*** and ***editor support ([VSCode][2] & [Sublime Text][3])***.

## 🙌 Why HandyLLM?

📃 **Handy Prompt**: self-containing prompt in a human-friendly mark-up format `.hprompt`.

- **Easy write**: mark-up format, placeholder variables, request arguments, output logs... And most importantly syntax highlight!
- **Easy run**: both CLI and APIs available for parsing and running; run it with the CLI tool *WITHOUT* any code!
- **Easy chain**: You can chain `hprompt` files to construct dynamic logic.


screenshot_vscode
screenshot_st

**Other features:**

☯️ Unified API design with both sync and async support

🍡 OpenAI and Azure APIs all in one

☕️ Easy life with API endpoint management

## Installation

```shell
pip3 install handyllm
```

or, install from the Github repo to get latest updates:

```shell
pip3 install git+https://github.com/atomiechen/handyllm.git
```

Please check HandyLLM [VSCode extension][2] or [Sublime Text Package][3] for editor support.

## Documentation

Please check out our [wiki](https://github.com/atomiechen/HandyLLM/wiki) for comprehensive guides ^_^

## License

[HandyLLM][0] © 2024 by [Atomie CHEN](https://github.com/atomiechen) is licensed under the MIT License - see the [LICENSE](https://github.com/atomiechen/HandyLLM/blob/main/LICENSE) file for details.

[0]: https://github.com/atomiechen/HandyLLM
[1]: https://pypi.org/project/HandyLLM/
[2]: https://marketplace.visualstudio.com/items?itemName=atomiechen.handyllm
[3]: https://packagecontrol.io/packages/HandyLLM