Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/ericbatlle/unityandroidspeechrecognizer
🗣️ Speech recognition on Unity and Android without the annoying google popup!
https://github.com/ericbatlle/unityandroidspeechrecognizer
android android-plugin plugin speech-recognition speech-to-text unity unity3d
Last synced: about 1 month ago
JSON representation
🗣️ Speech recognition on Unity and Android without the annoying google popup!
- Host: GitHub
- URL: https://github.com/ericbatlle/unityandroidspeechrecognizer
- Owner: EricBatlle
- License: mit
- Created: 2020-03-27T22:55:25.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2023-03-05T16:27:57.000Z (almost 2 years ago)
- Last Synced: 2024-05-01T19:04:43.747Z (8 months ago)
- Topics: android, android-plugin, plugin, speech-recognition, speech-to-text, unity, unity3d
- Language: ShaderLab
- Homepage:
- Size: 26.4 MB
- Stars: 57
- Watchers: 4
- Forks: 12
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# UnityAndroidSpeechRecognizer 🗣️
*Created by Eric Batlle Clavero*
A simple **Android App** made with **Unity** that implements a **Speech Recognizer** using Android native recognizer.
**Without** the annoying **pop-up** and the option to keep the app **listening indefinitely**, not just once.
This repository is divided in 2 parts:
- Unity Project (**C#**)
- Android Plugin (**Java**)
## Example 🎬
*In this image it is possible to see multiple results appearing on the panel after speaking to the device "continuous text speech". *
## Donations are appreciated! 💸
*Remember that are many ways to say thank you.*
If this plugin has been helpful remember to star the repository and consider buying me a coffee! 😀
If you like my general work and contributions consider [sponsoring me on Github](https://github.com/sponsors/EricBatlle).
But if you just want to donate straightforward, I also have [PayPal.me](https://paypal.me/EricBatlleClavero?locale.x=es_ES).
## How to Install :hammer_and_wrench:
- If you want to install the the app, you can download the APK from [here](https://github.com/EricBatlle/UnityAndroidSpeechRecognizer/releases/download/v1.3/SpeechRecognizer_1.3.apk).
- If you want to install the whole project and check the code, you need to have **Unity** and **AndroidStudio** installed and updated.
- If you want to install only the few files to make the plugin work and don't want the whole project, you only need to import the package **SpeechRecognizer_pckg** located inside ``UnitySpeechRecognizer/Assets/``. To import it simply drag and drop the file in your current Unity project. Remember that you can also download the package without cloning the project, simply clicking this [link](https://github.com/EricBatlle/UnityAndroidSpeechRecognizer/raw/v1.3.support/UnitySpeechRecognizer/Assets/SpeechRecognizer_pckg.unitypackage).
## How to Use ⚙️
#### How to use the Demo:
- Functionality is simple, just press the **Start Listening button** and talk to your device to check the results!
- If you want to enable/disable continuous listening mode simply press the **Continous Listening checkmark**.
- You can also stop the current recongizer by pressing the **Stop Listening button**.
- Set the language of the recognizer or the maximum results you want that the recognizer retrieves.
#### How to use the Plugin:
To call the plugin you first need a variable to reference it:
```csharp
private SpeechRecognizerPlugin plugin = null;
```
Then you have to create a new platform-specific instance by calling:
```csharp
plugin = SpeechRecognizerPlugin.GetPlatformPluginVersion(this.gameObject.name);
```
Notice that ``this.gameObject.name`` is the name of the GameObject that will have the plugin callback methods to retrieve the recognition results and errors.
To create those callbacks you need to add and implement the Interface ```ISpeechRecognizerPlugin``` on the same GameObject. A common implementation of the interface will be:
```csharp
public void OnResult(string recognizedResult)
{
char[] delimiterChars = { '~' };
string[] results = recognizedResult.Split(delimiterChars);
//Do something with the results
}
public void OnError(string recognizedError)
{
ERROR error = (ERROR)int.Parse(recognizedError);
switch (error)
{
case ERROR.UNKNOWN:
Debug.Log("ERROR: Unknown");
break;
case ERROR.INVALID_LANGUAGE_FORMAT:
Debug.Log("ERROR: Language format is not valid");
break;
default:
break;
}
}
```
From so on every time you want to call any plugin feature you only have to call it like any other object:
Do you want to start the recognition?
```csharp
plugin.StartListening();
```
Do you want to stop it?
```csharp
plugin.StopListening();
```
Do you want to start the recognition with continous recognition and specific language?
```csharp
plugin.StartListening(true, "es-ES");
```
#### How to scratch the code:
- To check **Unity** project, **open the project**, select **SpeechRecognizer** scene.
Either inside the unity project or simply dragging the **.cs** classes on your editor, you have to watch on to the classes located on ``UnitySpeechRecognizer/Assets/Scripts``.
- To check **Android Plugin** you can do it opening the solution with **AndroidStudio** or just drag the ``SpeechRecognizerFragment.java`` class located on ``UnitySpeechRecognizerPlugin\SpeechRecognizer\src\main\java\com\example\eric\unityspeechrecognizerplugin``
## Multiple plugins support 🔌
This plugin has been made following a **fragment-pattern** to avoid errors that can be derived from extending *UnityPlayerActivity*.
This way you can integrate this plugin with your projects even if they already have more plugins. **Truly pluggable**.
## Upgrading dependencies and choosing plugin version 📜
Keep in mind that the latest versions [v1.3](https://github.com/EricBatlle/UnityAndroidSpeechRecognizer/releases/tag/v1.3) and [v1.3.support](https://github.com/EricBatlle/UnityAndroidSpeechRecognizer/releases/tag/v1.3.support) of the plugin work with different android support libraries even if they have identical features.
- **[v1.3](https://github.com/EricBatlle/UnityAndroidSpeechRecognizer/releases/tag/v1.3)** works with **AndroidX** dependencies. That means that is targeting **Android 9** (API level 28).
- **[v1.3.support](https://github.com/EricBatlle/UnityAndroidSpeechRecognizer/releases/tag/v1.3.support)** works with **Support-v4** dependencies. That means that is targeting **Android 7** (API level 24).
### Why multiple versions and when to use each one?
Basically cause there are multiple plugins and SDK's out there that work with similar libraries or different API requirements.
If your other plugins and SDK's use API lvl 28 or above, choose [v1.3](https://github.com/EricBatlle/UnityAndroidSpeechRecognizer/releases/tag/v1.3) version.
If you need to target older devices (to a minimum of API level 24) choose [v1.3.support](https://github.com/EricBatlle/UnityAndroidSpeechRecognizer/releases/tag/v1.3.support) version.
## Controlled Exceptions 🚨
How to solve some of the most typical exceptions when trying to deal with multiple plugins
#### Duplicate class XXXXX found in modules classes.jar (androidx.core:core:1.0.0) and classes.jar (com.android.support:support-compat:27.1.1)
This exceptions means that another of your project plugins is using a library (like androidX) that internally uses the same class as another library that is using the current plugin.
The easiest way to solve this problem is to remove one of the lib file (usually .aar) from one of the two plugins. Keep in mind that this is only valid in case that the erased library is using specific classes that exists in the prior one.
In case you have Player Service Resolver on your project you can also do "Delete Resolved Libraries" and "Resolve".