Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/MycroftAI/mycroft-gui
The Graphical User Interface used by the Mycroft Mark II and more
https://github.com/MycroftAI/mycroft-gui
Last synced: about 1 month ago
JSON representation
The Graphical User Interface used by the Mycroft Mark II and more
- Host: GitHub
- URL: https://github.com/MycroftAI/mycroft-gui
- Owner: MycroftAI
- License: apache-2.0
- Created: 2018-11-19T07:22:37.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2023-07-01T04:53:50.000Z (about 1 year ago)
- Last Synced: 2024-06-24T01:38:45.266Z (3 months ago)
- Language: C++
- Size: 2.64 MB
- Stars: 164
- Watchers: 23
- Forks: 54
- Open Issues: 18
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-mycroft-community - Project Link
README
Mycroft GUI
===========
Graphical User Interface powered by Qt and Kirigami for [Mycroft AI](https://github.com/MycroftAI/mycroft-core)
_______________________________________________________________________
- [Getting Started](#getting-started)
+ [General setup instructions](#general-setup-instructions)
+ [Virtual environment setup instructions](#virtual-environment-setup-instructions)
- [Usage](#usage)
+ [Local environment](#local-environment)
+ [Remote environment](#remote-environment)
- [Development & Contributing](#development-contributing)
+ [Contributing to Mycroft GUI API](#contributing-to-mycroft-gui-api)
+ [Developing skills with an User Interface](#developing-skills-with-an-user-interface)
- [Troubleshooting](#troubleshooting)
- [Debugging Mycroft GUI](#debugging-mycroft-gui)
_____________________________________________________________________________________________
## Getting Started
The following guide will provide a set of instructions to get you started with installing Mycroft GUI on your system. *Note:* All non virtual environment setups should generally follow the [General Setup Instructions](#general-setup-instructions) steps.
###
### General Setup Instructions
The interactive Installation script supports installation on KDE Neon, K/Ubuntu 20.04 & Manjaro Linux, It also supports installation and building on other distributions and platforms but system dependencies will be have to installed manually as mentioned in the Installation Script.
1) Fetch Repository and Run Installation Script
```@bash
cd ~
git clone https://github.com/mycroftai/mycroft-gui
cd mycroft-gui
bash dev_setup.sh
```
2) Running Mycroft GUI:
```@bash
mycroft-gui-app
```
### Virtual Environment Setup Instructions
1) Download and Install [VirtualBox](https://www.virtualbox.org/wiki/Downloads)
2) Download Latest (Any Supported) Distribution ISO.
3) Open VirtualBox and create a system installation
4) Within the VM, open a terminal session and type:
```@bash
cd ~
git clone https://github.com/mycroftai/mycroft-gui
cd mycroft-gui
bash dev_setup.sh
```
5) (Optional) Customize Plasma settings for GUI debugging purposes
* Disable screensaver
- Click the > icon, type: Screen Locking
- Untick "Lock screen automatically after:"
- Click OK
6. Running Mycroft GUI:
```@bash
mycroft-gui-app
```
##
## Usage
Mycroft GUI can be used on an Local Environment as well as a Remote Environment
###
### Local Environment
Note: Boot your device or run `./start-mycroft.sh all`
1) Invoke using ```mycroft-gui-app``` in any terminal, or Mycroft icon from your desktop application launcher.
2) Click *Start* button in the middle of the window if Autoconnect is disabled
3) Talk to your Mycroft!
### Remote Environment
Note: Remote device / server must have mycroft services running or `./start-mycroft.sh all` on remote device / server
1. Invoke using `mycroft-gui-app` in any remote terminal session, or Mycroft icon from your remote desktop/platform application launcher.
2. Configuring Mycroft GUI for externally hosted Mycroft-Core:
- Click on the hamburger menu in the lower left
- Select 'Settings'
- Enter the IP address of your device. If your device is at 192.168.2.2, enter 'ws://192.168.2.2'
- Close
3. Click *Start* button in the middle of the window if Autoconnect is disabled
4. Talk to your Mycroft!
5. Additional Notes:
- CAUTION: The Mycroft messagebus is an open websocket with no built-in security measures by default. We strongly recommend that you do not expose the messagebus ports outside a secure LAN/PAN unless you have other security measures in place.
- For Externally Hosted Mycroft-Core, one would require to sync skills, one can simply use the provided sync script from the repository to perform a sync
- Run `bash sync_skills.sh 192.168.1.1 [replace with your remote ip] `
- For Externally Hosted Mycroft-Core, but sure to disable the firewall on the Raspberry Pi. You can do this via `sudo ufw disable`
- Generally, the GUI interaction is managed by an enclosure-specific skill that orchestrates things. For example, the Mark 2 uses skill-mark-2.
- Lightweight debugging can be done from Mycroft's CLI. You can see commands being sent to GUI clients by hitting Ctrl+G within the CLI
- Multiple GUIs can safely run against a single Mycroft Core instance.
##
## Development & Contributing
Users & Developers can contribute in advancement of Mycroft GUI in several ways, below mentioned methods will help you identify contribution targets.
### Contributing To Mycroft GUI API
Mycroft GUI API is the protocol layer designed to talk and integrate with Mycroft Core Services, It handles various functions some of which include setting, managing and parsing session data and handling delegate activities for skill instances, API Implementation documentation can be found at:
- [Transport Protocol Documentation](https://github.com/MycroftAI/mycroft-gui/blob/master/transportProtocol.md)
- [Enclosure API Implementation - Mycroft Core](https://github.com/MycroftAI/mycroft-core/blob/dev/mycroft/enclosure/gui.py)
### Developing Skills With An User Interface
Mycroft enabled devices with displays such as the Mark II, KDE Plasmoid provide skill developers the opportunity to create skills that can be empowered by both voice and screen interaction. The display interaction technology is based on the QML user interface markup language that gives you complete freedom to create in-depth innovative interactions without boundaries, A detailed documentation on getting started with developing skills with an user Interface is available at [Mycroft Documentation - Displaying Information](https://mycroft-ai.gitbook.io/docs/skill-development/displaying-information/mycroft-gui)
## Troubleshooting
Having trouble or facing issues with Mycroft GUI ? You can use the below guide to debug Mycroft GUI
### Debugging Mycroft GUI
1. **Debugging Mycroft GUI Application:**
- Run Mycroft GUI application from a terminal
- Errors should be visible on teriminal output, copy output to a log file
- Open a relevant issue and post your log file
2. **Debugging Skills & Session Data**:
- Start Mycroft CLI client and use ctrl+g to view session data being passed to Mycroft GUI
- For more detailed logging add { "log_level": "debug"} to your mycroft system configuration
- More detailed logs can be retrived from "/var/logs/mycroft/enclosure.log" & "/var/logs/mycroft/skills.log"
3. **Debugging on Remote Device (Example: Mark-1)**:
- SSH to the Mark 1
- Run `sudo service mycroft-enclosure-client stop`
- Run `sudo su mycroft`
- Run `mycroft-enclosure-client` This will start the client and show Debug() messages on the console.
##