Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/pkarpovich/kira-client
An AI-powered voice automation tool for IoT, integrating voice-triggered commands, OpenAI-driven intent recognition, and HTTP server management for seamless control of smart devices
https://github.com/pkarpovich/kira-client
ai-assistant intent-classification porcupine trigger-word-detection whisper
Last synced: about 19 hours ago
JSON representation
An AI-powered voice automation tool for IoT, integrating voice-triggered commands, OpenAI-driven intent recognition, and HTTP server management for seamless control of smart devices
- Host: GitHub
- URL: https://github.com/pkarpovich/kira-client
- Owner: pkarpovich
- License: mit
- Created: 2023-06-27T15:36:39.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-05-03T21:49:02.000Z (7 months ago)
- Last Synced: 2024-05-03T22:45:08.716Z (7 months ago)
- Topics: ai-assistant, intent-classification, porcupine, trigger-word-detection, whisper
- Language: Python
- Homepage:
- Size: 333 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Kira Client
## Overview
Kira Client is an AI-driven application designed for automating IoT tasks using voice commands. It listens for a specific trigger word, processes spoken instructions to comprehend user intent, and executes actions on IoT devices. The application integrates with OpenAI's API for advanced intent recognition
## Key Features
- **Voice Activation**: Activates upon hearing a pre-defined trigger word.
- **Audio Capture & Analysis**: Records and analyzes spoken instructions.
- **Advanced Intent Recognition**: Leverages OpenAI API to accurately interpret user intents.
- **Dynamic IoT Interaction**: Sends requests to IoT devices based on interpreted intents.
- **Visual Feedback System**: Uses an LED strip to provide visual status updates.
## Enhanced Intent Recognition
Kira Client utilizes a sophisticated intent recognition system powered by OpenAI. The system interprets user commands based on a configured list of intents. Each intent includes a name, description, and associated action.
Example intent configuration:
```json
[
{
"name": "NewMeeting",
"description": "create a new meeting",
"action": {
"type": "request",
"options": {
"url": "http://localhost:8090/execute?name=Create Google Meet",
"method": "GET"
}
}
}
]
```
## Workflow
1. Waits for the trigger word to start the listening mode.
2. Records and transcribes the subsequent spoken instructions.
3. The OpenAIClient interprets the intent using the provided template.
4. Executes actions on IoT devices based on the recognized intent
## HTTP Server Functionality
Kira Client incorporates an HTTP server to manage voice trigger detection and initiate intent recognition.
### Key Endpoints
- `/intents/start-recognition`: Pauses the voice trigger detector and starts listening for text to recognize the intent.
## Installation
### Prerequisites
- Python 3.11+
- Poetry
- PortAudio
### Steps
1. Clone the repository
2. Install dependencies using Poetry
```bash
poetry install
```
3. Run the application
```bash
poetry run python kira_client/main.py
```
## License
This project is licensed under the MIT License - [MIT license](/LICENSE).