https://github.com/schbenedikt/ai-agent
Testing macOS AI Agent with Google Gemini Live Web API
https://github.com/schbenedikt/ai-agent
agent ai free gemma google google-ai macos
Last synced: 8 months ago
JSON representation
Testing macOS AI Agent with Google Gemini Live Web API
- Host: GitHub
- URL: https://github.com/schbenedikt/ai-agent
- Owner: SchBenedikt
- Created: 2025-04-08T15:26:26.000Z (9 months ago)
- Default Branch: main
- Last Pushed: 2025-04-09T18:43:16.000Z (9 months ago)
- Last Synced: 2025-05-09T02:15:25.769Z (8 months ago)
- Topics: agent, ai, free, gemma, google, google-ai, macos
- Language: Python
- Homepage:
- Size: 38.1 KB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Gemini Assistant macOS App
A native macOS application that connects to Google's Gemini AI. The app automatically accesses your camera and microphone to provide a seamless AI assistant experience.
## Features
- Audio input through your microphone
- Visual context through your camera
- Text responses displayed in the app
- Audio responses played through your speakers
## Setup
### Prerequisites
1. Python 3.8+
2. A Google Gemini API key
### Installation
1. Install the required dependencies:
```
pip install google-generativeai opencv-python pyaudio pillow mss PyQt5 pynput python-dotenv pyinstaller
```
2. Set your Gemini API key as an environment variable (optional):
```
export GEMINI_API_KEY="your-api-key-here"
```
If not set as an environment variable, the app will ask for it on startup.
### Building the macOS App
There are two ways to build the app:
#### Method 1: Using PyInstaller (Recommended)
PyInstaller creates a more reliable standalone application that better handles dependencies:
1. Make sure PyInstaller is installed:
```
pip install pyinstaller
```
2. Run the build process:
```
# First clean any previous builds
rm -rf build dist
# Create the app bundle using the spec file
pyinstaller gemini.spec
```
3. The app will be created as `Gemini Assistant.app` in the `dist` folder
#### Method 2: Using py2app (Alternative)
This method may have issues with certain dependencies:
1. Make sure py2app is installed:
```
pip install py2app
```
2. Run the build process:
```
# First clean any previous builds
rm -rf build dist
# Create the app bundle
python setup.py py2app --alias
```
3. The app will be created in the `dist` folder. Using the `--alias` flag creates a development version that's easier to build.
### Running Without Building
To run directly without building:
```
python app.py
```
## Usage
1. Launch the app
2. Grant camera and microphone permissions when prompted
3. The app will automatically start listening and capturing video
4. Click the button to toggle listening on/off
## Troubleshooting
### Common Issues
- **Missing Modules**: If you encounter "No module named 'xyz'" errors, install the missing dependency with `pip install xyz`
- **Permission Issues**: If camera or microphone access doesn't work, check your macOS privacy settings
- **Build Errors**: If PyInstaller fails with recursion errors, try using the '--debug' flag to identify problematic dependencies
### Building Tips
- The PyInstaller spec file (`gemini.spec`) is configured to include all necessary dependencies
- For development, the alias mode (`--alias`) creates a simpler app bundle that points to your source files
- For distribution, use the default (non-alias) mode to create a completely standalone application