Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/suvansh/CeLLM

applying LLM prompting to spreadsheets
https://github.com/suvansh/CeLLM

Last synced: 9 days ago
JSON representation

applying LLM prompting to spreadsheets

Awesome Lists containing this project

README 

        
# Getting started

1. Generate the `all.gs` file containing all the code (or use the existing one if you haven't made changes):

```

chmod +x gen_all.sh

./gen_all.sh

```

2. Go to the Google Sheets spreadsheet that you would like to use CeLLM in. In the menu, click **Extensions → Apps Script**. This will open an Apps Script editor.

3. Replace the default `Code.gs` file contents with the contents of `all.gs` from Step 1. Add an HTML file with the + icon and name it `Sidebar`. Fill in the contents from the [`Sidebar.html`](Sidebar.html) in the repo. Save the project.

4. Refresh the Google Sheets. After a few seconds, a menu called "CeLLM" should appear in the menu bar. This means the add-on has loaded.

5. Click **CeLLM → Setting**s**. You will be prompted to authorize the script. After authorizing, return to Settings. Enter your API keys and click Save. This information is saved to the [User Properties service](https://developers.google.com/apps-script/guides/properties) and is only accessible to your account on this spreadsheet. If you share the spreadsheet, other users will not see your API keys and will need to enter their own in order to use CeLLM in the spreadsheet.

6. You should now be able to use the **CeLLM → Generate List** feature as well as the spreadsheet functions `CELLM`, `CELLM_EX`, and `CELLM_URL` (in development). These functionalities are documented below.



# Documentation

Note that the spreadsheet functions (starting with `CELLM`) must include arguments in order. That means if you want to specify the temperature, you must specify all preceding arguments as well. This is due to lack of support in JavaScript for keyword arguments.

## Generate List

This functionality is useful for using LLMs to generate lists of items across multiple cells. Due to access limitations, this functionality can't be accomplished through spreadsheet functions, so it's tucked away in **CeLLM → Generate List**.

First input: prompt describing list |  Second input: cell starting the list | Output

:---------------------:|:---------------------:|:---------------------:

![The first input to Generate List is the prompt describing the list.](screenshots/gen_list1.png "The first input to Generate List is the prompt describing the list.")  |  ![The second input to Generate List is the cell where the list is to begin.](screenshots/gen_list2.png "The second input to Generate List is the cell where the list is to begin.")  |  ![The output shows the generated list across multiple cells.](screenshots/gen_list3.png "The output shows the generated list across multiple cells.")



## `CELLM`

This is the spreadsheet function used to apply a prompt to a cell. The function is called as follows:

```

CELLM(prompt, input, llm, arcus, max_tokens, temperature)

```

The first argument is required, and the rest are optional, though `input` will usually be specified as a spreadsheet cell value to be inserted into the prompt.

- `prompt` (string): The prompt to apply to the input. Any occurrences of the string "{input}" in the prompt will be replaced with the value of the `input` parameter. If no occurrences are found, the input will be appended to the end of the prompt instead.

- `input` (string): The value to be combined with the prompt as described above. Defaults to the empty string.

- `llm` (optional, string): One of "OpenAI" (default) or "Anthropic", optionally including a colon-separated model name selected from "gpt-3.5-turbo" (default) or "gpt-4" (if your API key has access) for OpenAI, or the model options found [here](https://console.anthropic.com/docs/api/reference#-v1-complete) (default "claude-instant-v1") for Anthropic. For example, "OpenAI:gpt-4" uses OpenAI's GPT-4 model, and "Anthropic:claude-v1-100k" uses Anthropic's Claude v1 model that accepts a 100k token context window.

- `arcus` (optional, boolean): Whether or not to use Arcus' [prompt enrichment](https://app.arcus.co/docs/prompt/key-concepts/) to add in relevant data to the prompt when available. Requires Arcus API key to be set in **CeLLM → Settings**. Default `false`.

- `max_tokens` (integer): The maximum number of tokens allowed for the LLM response. Defaults to 250 to prevent rapid cost increases (OpenAI and Anthropic charge by the token).

- `temperature` (float): A value between 0-2 (OpenAI) or 0-1 (Anthropic). Per the OpenAI documentation, higher values will make the output more random, while lower values will make it more focused and deterministic. Defaults to 0.3.



An example of the CELLM function to write stories about creatures from Greek mythology.

An example of Arcus prompt enrichment providing relevant contextual information to reduce LLM hallucinations and improve accuracy.

An example of the CELLM function to write stories about creatures from Greek mythology.



## `CELLM_EX`

This is the spreadsheet function used to generate outputs using example input-output pairs, rather than a prompt, to specify the task. The function is called as follows:

```

CELLM_EX(exampleInputs, exampleOutputs, testInput, llm, arcus, max_tokens, temperature)

```

The first three arguments are required, and the rest are optional.

- `exampleInputs` (cell range): The inputs for the example pairs. For example, A1:A5.

- `exampleOutputs` (cell range): The outputs for the example pairs.

- `testInput` (string): The input to produce an output for, based on the example input-output pairs.



The rest of the arguments are as described for `CELLM`, but `arcus` is ignored and set to `false` for now.



An example of the CELLM_EX function to infer the task of generating company CEO names from examples.



## `CELLM_URL`

This is the (in-development) spreadsheet function used to apply a prompt to a webpage. It can be used to extract information from a webpage with an LLM. The function is called as follows:

```

CELLM_URL(prompt, url, llm, arcus, max_tokens, temperature)

```

The first two arguments are required, and the rest are optional.

- `prompt` (string): The prompt to apply to the input. Any occurrences of the string "{input}" in the prompt will be replaced with the content of the webpage fetched from the `url` parameter. If no occurrences are found, the webpage content will be appended to the end of the prompt instead.

- `url` (string): The content of the `` tag in the HTML fetched from this URL is stripped of HTML tags and used as input to the prompt.



The rest of the arguments are as described for `CELLM`, but `arcus` is ignored and set to `false` for now.



**NOTE**:

- Due to the token-based pricing, this function can run up costs pretty quickly.

- Long webpages can result in hitting the LLM max token limit.

- Specifying one of Anthropic's 100k token models (such as with `llm="Anthropic:claude-v1-100k"` or `llm="Anthropic:claude-instant-v1-100k"`) allows CeLLM to process much longer webpages. Be mindful of running up costs with large webpages though.



An example of the CELLM_URL function to extract structured information from apartment listings using LLMs.