An open API service indexing awesome lists of open source software.

https://github.com/13point5/gemini-cursor

An AI cursor for desktop using Gemini 2.0 Flash (Experimental)
https://github.com/13point5/gemini-cursor

Last synced: 11 months ago
JSON representation

An AI cursor for desktop using Gemini 2.0 Flash (Experimental)

Awesome Lists containing this project

README

          

# Gemini Cursor ✨

A second AI cursor 🖱️ for your desktop that can see your screen, hear you speak, and talk to you.

![Demo](./readme/demo.gif)

Powered by Google's Gemini 2.0 Flash (Experimental) model, the Multimodal Live API, Pointing, and Function calling capabilities.

Created by [@13point5](https://x.com/27upon2).

## Features

- 🖱️ Second AI cursor on your desktop
- 🚀 Multimodality: The model can see 📸, hear 🎤, and speak 🔊
- ⚡️ Real-time with low latency

## Use Cases

- 📚 Understanding complex diagrams in Research papers, Architecture diagrams, etc
- 🌐 Navigating complex websites to perform a task like adding a payment method on Amazon
- 📝 Real time AI tutor with whiteboards

## Tech Stack

- Frontend: Electron, React, TypeScript, Vite
- AI: Google Gemini API

## Acknowledgements

- A lot of code from the Gemini [Multimodal Live API Web console](https://github.com/google-gemini/multimodal-live-api-web-console)
- Built using Google's [Multimodal Live API](https://ai.google.dev/gemini-api/docs/multimodal-live)

## Prerequisites

- Node.js (v16 or higher)
- npm
- [Gemini API key](https://aistudio.google.com/apikey)

## Installation

1. Clone the repository

```bash
git clone https://github.com/13point5/gemini-cursor.git
cd gemini-cursor
```

2. Install dependencies

```bash
npm install
```

3. Run the app

```bash
npm run start
```

4. Enter the Gemini API key in the app

5. Click the Play button and the Share Screen button

6. Minimize the app and enjoy!