https://github.com/google-gemini/gemini-live-api-examples

Gemini Live provides multimodal realtime agent capabilities. Build voice agents that can process vision and text in realtime.
https://github.com/google-gemini/gemini-live-api-examples

Last synced: 3 months ago
JSON representation

Gemini Live provides multimodal realtime agent capabilities. Build voice agents that can process vision and text in realtime.

• Host: GitHub
• URL: https://github.com/google-gemini/gemini-live-api-examples
• Owner: google-gemini
• License: apache-2.0
• Created: 2026-02-14T06:39:30.000Z (5 months ago)
• Default Branch: main
• Last Pushed: 2026-03-26T17:25:09.000Z (4 months ago)
• Last Synced: 2026-03-27T07:21:45.522Z (4 months ago)
• Language: JavaScript
• Homepage: https://ai.google.dev/gemini-api/docs/live
• Size: 184 KB
• Stars: 46
• Watchers: 0
• Forks: 11
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-voice-agents - Gemini Live API Examples - gemini/gemini-live-api-examples) | Official Google sample apps for the Gemini Live realtime voice/video API across web, mobile and backends. | Google 官方 Gemini Live 实时语音 API 示例集 | (End-to-End Speech Models | 端到端语音模型 / Speech-to-Speech & Full-Duplex Models | 语音对话与全双工模型)

README

          
# Gemini Live API Examples

The Live API enables low-latency, real-time voice and video interactions with

Gemini. It processes continuous streams of audio, video, or text to deliver

immediate, human-like spoken responses, creating a natural conversational

experience for your users.

![Live API Overview](https://ai.google.dev/gemini-api/docs/images/live-api-overview.png)

[Try the Live API in Google AI Studio](https://aistudio.google.com/live)

## Example use cases

Live API can be used to build real-time voice and video agents for a

variety of industries, including:

*   **E-commerce and retail:** Shopping assistants that offer personalized

    recommendations and support agents that resolve customer issues.

*   **Gaming:** Interactive non-player characters (NPCs), in-game help

    assistants, and real-time translation of in-game content.

*   **Next-gen interfaces:** Voice- and video-enabled experiences in robotics,

    smart glasses, and vehicles.

*   **Healthcare:** Health companions for patient support and education.

*   **Financial services:** AI advisors for wealth management and investment

    guidance.

*   **Education:** AI mentors and learner companions that provide personalized

    instruction and feedback.

## Key features

Live API offers a comprehensive set of features for building

robust voice and video agents:

*   [**Multilingual support**](https://ai.google.dev/gemini-api/docs/live-guide#supported-languages):

    Converse in 70 supported languages.

*   [**Barge-in**](https://ai.google.dev/gemini-api/docs/live-guide#interruptions):

    Users can interrupt the model at any time for responsive interactions.

*   [**Tool use**](https://ai.google.dev/gemini-api/docs/live-tools):

    Integrates tools like function calling and Google Search for dynamic

    interactions.

*   [**Audio transcriptions**](https://ai.google.dev/gemini-api/docs/live-guide#audio-transcription):

    Provides text transcripts of both user input and model output.

*   [**Proactive audio**](https://ai.google.dev/gemini-api/docs/live-guide#proactive-audio):

    Lets you control when the model responds and in what contexts.

*   [**Affective dialog**](https://ai.google.dev/gemini-api/docs/live-guide#affective-dialog):

    Adapts response style and tone to match the user's input expression.

## Technical specifications

The following table outlines the technical specifications for the

Live API:

| Category          | Details                                                                                     |

| :---------------- | :------------------------------------------------------------------------------------------ |

| Input modalities  | Audio (raw 16-bit PCM audio, 16kHz, little-endian), images/video (JPEG <= 1FPS), text       |

| Output modalities | Audio (raw 16-bit PCM audio, 24kHz, little-endian), text                                    |

| Protocol          | Stateful WebSocket connection (WSS)                                                         |

## Examples

*   **[Gen AI SDK Python example](./gemini-live-genai-python-sdk/README.md)**: Recommended for ease of use. Connect to the Gemini Live API using the Gen AI SDK to build a real-time multimodal application with a Python backend.

*   **[Epheremal tokens and raw WebSocket example](./gemini-live-ephemeral-tokens-websocket/README.md)**: RAW protocol control. Connect to the Gemini Live API using WebSockets to build a real-time multimodal application with a JavaScript frontend and a Python backend.

*   **[Command-line Python example](./command-line/python/README.md)**: A minimal command-line app that streams microphone audio to the Gemini Live API and plays back the response in real time using Python.

*   **[Command-line Node.js example](./command-line/node/README.md)**: A minimal command-line app that streams microphone audio to the Gemini Live API and plays back the response in real time using Node.js.

> [!TIP]

> Install the [Gemini Live API Dev](https://github.com/google-gemini/gemini-skills?tab=readme-ov-file#gemini-live-api-dev) skill for AI-assisted development with the Live API in your coding agents.

## Partner integrations

To streamline the development of real-time audio and video apps, you can use

a third-party integration that supports the Gemini Live

API over WebRTC or WebSockets.

*   [LiveKit](https://docs.livekit.io/agents/models/realtime/plugins/gemini/): Use the Gemini Live API with LiveKit Agents.

*   [Pipecat by Daily](https://docs.pipecat.ai/guides/features/gemini-live): Create a real-time AI chatbot using Gemini Live and Pipecat.

*   [Fishjam by Software Mansion](https://docs.fishjam.io/tutorials/gemini-live-integration): Create live video and audio streaming applications with Fishjam.

*   [Vision Agents by Stream](https://visionagents.ai/integrations/gemini): Build real-time voice and video AI applications with Vision Agents.

*   [Voximplant](https://voximplant.com/products/gemini-client): Connect inbound and outbound calls to Live API with Voximplant.

*   [Agent Development Kit (ADK)](https://google.github.io/adk-docs/streaming/): Create an agent and use the Agent Development Kit (ADK) Streaming to enable voice and video communication.

*   [Firebase AI SDK](https://firebase.google.com/docs/ai-logic/live-api?api=dev): Get started with the Gemini Live API using Firebase AI Logic.