Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/simonw/llm-gemini
LLM plugin to access Google's Gemini family of models
https://github.com/simonw/llm-gemini
Last synced: 10 days ago
JSON representation
LLM plugin to access Google's Gemini family of models
- Host: GitHub
- URL: https://github.com/simonw/llm-gemini
- Owner: simonw
- License: apache-2.0
- Created: 2023-12-13T20:17:45.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2024-10-03T20:30:28.000Z (about 1 month ago)
- Last Synced: 2024-10-18T07:53:46.355Z (22 days ago)
- Language: Python
- Size: 25.4 KB
- Stars: 109
- Watchers: 6
- Forks: 8
- Open Issues: 8
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# llm-gemini
[](https://pypi.org/project/llm-gemini/)
[](https://github.com/simonw/llm-gemini/releases)
[](https://github.com/simonw/llm-gemini/actions?query=workflow%3ATest)
[](https://github.com/simonw/llm-gemini/blob/main/LICENSE)
API access to Google's Gemini models
## Installation
Install this plugin in the same environment as [LLM](https://llm.datasette.io/).
```bash
llm install llm-gemini
```
## Usage
Configure the model by setting a key called "gemini" to your [API key](https://aistudio.google.com/app/apikey):
```bash
llm keys set gemini
```
```
```
Now run the model using `-m gemini-1.5-pro-latest`, for example:
```bash
llm -m gemini-1.5-pro-latest "A joke about a pelican and a walrus"
```
> A pelican walks into a seafood restaurant with a huge fish hanging out of its beak. The walrus, sitting at the bar, eyes it enviously.
>
> "Hey," the walrus says, "That looks delicious! What kind of fish is that?"
>
> The pelican taps its beak thoughtfully. "I believe," it says, "it's a billfish."
### Images, audio and video
Gemini models are multi-modal. You can provide images, audio or video files as input like this:
```bash
llm -m gemini-1.5-flash-latest 'extract text' -a image.jpg
```
Or with a URL:
```bash
llm -m gemini-1.5-flash-8b-latest 'describe image' \
-a https://static.simonwillison.net/static/2024/pelicans.jpg
```
Audio works too:
```bash
llm -m gemini-1.5-pro-latest 'transcribe audio' -a audio.mp3
```
And video:
```bash
llm -m gemini-1.5-pro-latest 'describe what happens' -a video.mp4
```
The Gemini prompting guide includes [extensive advice](https://ai.google.dev/gemini-api/docs/file-prompting-strategies) on multi-modal prompting.
## Code execution
Gemini models can [write and execute code](https://ai.google.dev/gemini-api/docs/code-execution) - they can decide to write Python code, execute it in a secure sandbox and use the result as part of their response.
To enable this feature, use `-o code_execution 1`:
```bash
llm -m gemini-1.5-pro-latest -o code_execution 1 \
'use python to calculate (factorial of 13) * 3'
```
### Chat
To chat interactively with the model, run `llm chat`:
```bash
llm chat -m gemini-1.5-pro-latest
```
Other models are:
- `gemini-1.5-flash-latest`
- gemini-1.5-flash-8b-latest` - the least expensive
### Embeddings
The plugin also adds support for the `text-embedding-004` embedding model.
Run that against a single string like this:
```bash
llm embed -m text-embedding-004 -c 'hello world'
```
This returns a JSON array of 768 numbers.
This command will embed every `README.md` file in child directories of the current directory and store the results in a SQLite database called `embed.db` in a collection called `readmes`:
```bash
llm embed-multi readmes --files . '*/README.md' -d embed.db -m text-embedding-004
```
You can then run similarity searches against that collection like this:
```bash
llm similar readmes -c 'upload csvs to stuff' -d embed.db
```
See the [LLM embeddings documentation](https://llm.datasette.io/en/stable/embeddings/cli.html) for further details.
## Development
To set up this plugin locally, first checkout the code. Then create a new virtual environment:
```bash
cd llm-gemini
python3 -m venv venv
source venv/bin/activate
```
Now install the dependencies and test dependencies:
```bash
llm install -e '.[test]'
```
To run the tests:
```bash
pytest
```