An open API service indexing awesome lists of open source software.

https://github.com/rockchinq/flowity

A Scripting Language for Building LLM Apps
https://github.com/rockchinq/flowity

langchain llm programming-language

Last synced: about 2 months ago
JSON representation

A Scripting Language for Building LLM Apps

Awesome Lists containing this project

README

          

# Flowity

Programming language for building LLM workflows.
and its runtime implementation in Python.

## Installation

```bash
pip install flowity
```

## Write flowity code

```flowity
Hello, who are you?

$resp = $query()
$end($resp)
```

Any statements not starting with `$` are considered as prompt, and will be sent to the model while calling `$query()`, the response will be stored in the variable `$resp`.
Prompt will be cached until the next `$query()` call.

> Syntax details can be found [here](docs/Syntax.md).

## Run a workflow

```python
import os

# === Setup Langchain ===

from langchain_openai import ChatOpenAI

os.environ["OPENAI_API_KEY"] = "sk-xxxx" # Your OpenAI api key
# Set OPENAI_API_BASE if you're using a reverse proxy
# os.environ["OPENAI_API_BASE"] = "https://api.openai.com/v1"

model = ChatOpenAI()

# === Write Flowity Code ===

code = """
Hello, who are you?

$str = $query()
$end($str)
"""

# === Run Flowity Code ===

from flowity.rt import rtime

rt = rtime.FlowityRuntime()

ret = rt.run(
code=code,
model=model
)

print(ret)
```