Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/Picovoice/Porcupine
On-device wake word detection powered by deep learning
https://github.com/Picovoice/Porcupine
handsfree hotword hotword-detection hotword-detector keyword-spotter keyword-spotting on-device speech-recognition trigger-word-detection voice-activation wake-word wake-word-detection wake-word-engine
Last synced: 6 days ago
JSON representation
On-device wake word detection powered by deep learning
- Host: GitHub
- URL: https://github.com/Picovoice/Porcupine
- Owner: Picovoice
- License: apache-2.0
- Created: 2018-03-08T01:55:25.000Z (almost 7 years ago)
- Default Branch: master
- Last Pushed: 2024-10-28T18:32:25.000Z (about 1 month ago)
- Last Synced: 2024-10-31T09:18:52.414Z (about 1 month ago)
- Topics: handsfree, hotword, hotword-detection, hotword-detector, keyword-spotter, keyword-spotting, on-device, speech-recognition, trigger-word-detection, voice-activation, wake-word, wake-word-detection, wake-word-engine
- Language: Python
- Homepage: https://picovoice.ai/
- Size: 355 MB
- Stars: 3,757
- Watchers: 65
- Forks: 498
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-ios - Porcupine - On-device wake word detection engine for macOS, iOS, and watchOS, powered by deep learning. (Media / Audio)
- awesome-ios-star - Porcupine - On-device wake word detection engine for macOS, iOS, and watchOS, powered by deep learning. (Media / Audio)
README
# Porcupine
[](https://github.com/Picovoice/Porcupine/releases)
[](https://github.com/Picovoice/porcupine/)
[](https://github.com/Picovoice/porcupine/)
[](https://pypi.org/project/pvporcupine/)
[](https://www.nuget.org/packages/Porcupine/)
[](https://pkg.go.dev/github.com/Picovoice/porcupine/binding/go)
[](https://pub.dev/packages/porcupine_flutter)
[](https://www.npmjs.com/package/@picovoice/porcupine-react-native)
[](https://repo1.maven.org/maven2/ai/picovoice/porcupine-android/)
[](https://repo1.maven.org/maven2/ai/picovoice/porcupine-java/)
[](https://www.npmjs.com/package/@picovoice/porcupine-angular)
[](https://www.npmjs.com/package/@picovoice/porcupine-vue)
[](https://www.npmjs.com/package/@picovoice/porcupine-react)
[](https://www.npmjs.com/package/@picovoice/picovoice-node)
[](https://crates.io/crates/pv_porcupine)
Made in Vancouver, Canada by [Picovoice](https://picovoice.ai)
[](https://twitter.com/AiPicovoice)
[](https://www.youtube.com/channel/UCAdi9sTCXLosG1XeqDwLx7w)
Porcupine is a highly-accurate and lightweight wake word engine. It enables building always-listening voice-enabled
applications. It is
- using deep neural networks trained in real-world environments.
- compact and computationally-efficient. It is perfect for IoT.
- cross-platform:
- Arm Cortex-M, STM32, Arduino, and i.MX RT
- Raspberry Pi, NVIDIA Jetson Nano, and BeagleBone
- Android and iOS
- Chrome, Safari, Firefox, and Edge
- Linux (x86_64), macOS (x86_64, arm64), and Windows (x86_64)
- scalable. It can detect multiple always-listening voice commands with no added runtime footprint.
- self-service. Developers can train custom wake word models using [Picovoice Console](https://console.picovoice.ai/).
## Table of Contents
- [Porcupine](#porcupine)
- [Table of Contents](#table-of-contents)
- [Use Cases](#use-cases)
- [Try It Out](#try-it-out)
- [Language Support](#language-support)
- [Performance](#performance)
- [Demos](#demos)
- [Python](#python-demos)
- [.NET](#net-demos)
- [Java](#java-demos)
- [Go](#go-demos)
- [Unity](#unity-demos)
- [Flutter](#flutter-demos)
- [React Native](#react-native-demos)
- [Android](#android-demos)
- [iOS](#ios-demos)
- [Web](#web-demos)
- [Vanilla JavaScript and HTML](#vanilla-javascript-and-html)
- [Angular](#angular-demos)
- [React](#react-demos)
- [Vue](#vue-demos)
- [NodeJS](#nodejs-demos)
- [Rust](#rust-demos)
- [C](#c-demos)
- [Microcontroller](#microcontroller-demos)
- [SDKs](#sdks)
- [Python](#python)
- [.NET](#net)
- [Java](#java)
- [Go](#go)
- [Unity](#unity)
- [Flutter](#flutter)
- [React Native](#react-native)
- [Android](#android)
- [iOS](#ios)
- [Web](#web)
- [Vanilla JavaScript and HTML (CDN Script Tag)](#vanilla-javascript-and-html-cdn-script-tag)
- [Vanilla JavaScript and HTML (ES Modules)](#vanilla-javascript-and-html-es-modules)
- [Angular](#angular)
- [React](#react)
- [Vue](#vue)
- [NodeJS](#nodejs)
- [Rust](#rust)
- [C](#c)
- [Microcontroller](#microcontroller)
- [Releases](#releases)
- [FAQ](#faq)
## Use Cases
Porcupine is the right product if you need to detect one or a few static (always-listening) voice commands.
- If you want to create voice experiences similar to Alexa or Google, see the
[Picovoice platform](https://github.com/Picovoice/picovoice).
- If you need to understand complex and naturally-spoken voice commands within a specific domain, see the
[Rhino Speech-to-Intent engine](https://github.com/Picovoice/rhino).
## Try It Out
- [Interactive Web Demo](https://picovoice.ai/demos/lamp/)
- [Android Demo Application](https://play.google.com/store/apps/details?id=ai.picovoice.porcupine.demo&hl=en)
- Porcupine on a Raspberry Pi Zero
[](https://www.youtube.com/watch?v=Fi_IJEcNr3I)
## Language Support
- Arabic, Dutch, English, Farsi, French, German, Hindi, Italian, Japanese, Korean, Mandarin, Polish, Portuguese, Russian, Spanish, Swedish, and Vietnamese
- Support for additional languages is available for commercial customers on a case-by-case basis.
## Performance
A comparison between accuracy and runtime metrics of Porcupine and two other widely-used libraries, PocketSphinx and
Snowboy, is provided [here](https://github.com/Picovoice/wakeword-benchmark). Compared to the best-performing engine of
these two, Porcupine is **11.0 times more accurate** and **6.5 times faster** (on Raspberry Pi 3).
## Demos
If using SSH, clone the repository with:
```console
git clone --recurse-submodules [email protected]:Picovoice/porcupine.git
```
If using HTTPS, clone the repository with:
```console
git clone --recurse-submodules https://github.com/Picovoice/porcupine.git
```
### Python Demos
Install the demo package:
```console
sudo pip3 install pvporcupinedemo
```
With a working microphone connected to your device run the following in the terminal:
```console
porcupine_demo_mic --access_key ${ACCESS_KEY} --keywords porcupine
```
The engine starts processing the audio input from the microphone in realtime and outputs to the terminal when it detects
utterances of `Porcupine`.
For more information about Python demos go to [demo/python](demo/python).
### .NET Demos
From [demo/dotnet/PorcupineDemo](demo/dotnet/PorcupineDemo) run the
following in the terminal to build the demo:
```console
dotnet build -c MicDemo.Release
```
Make sure there is a working microphone connected to your device. From [demo/dotnet/PorcupineDemo](demo/dotnet/PorcupineDemo) run the
following in the terminal:
```console
dotnet run -c MicDemo.Release -- \
--access_key ${ACCESS_KEY} \
--keywords porcupine
```
The engine starts processing the audio input from the microphone in realtime and outputs to the terminal when it detects
utterances of `Porcupine`.
For more information about .NET demos go to [demo/dotnet](demo/dotnet).
### Java Demos
Make sure there is a working microphone connected to your device. Then invoke the following commands from the terminal:
```console
cd demo/java
./gradlew build
cd build/libs
java -jar porcupine-mic-demo.jar -a ${ACCESS_KEY} -k porcupine
```
The engine starts processing the audio input from the microphone in realtime and outputs to the terminal when it detects
utterances of `Porcupine`.
For more information about Java demos go to [demo/java](demo/java).
### Go Demos
The demo requires `cgo`, which on Windows may mean that you need to install a gcc compiler like [Mingw](http://mingw-w64.org) to build it properly.
From [demo/go](demo/go) run the following command from the terminal to build and run the mic demo:
```console
go run micdemo/porcupine_mic_demo.go \
-access_key "${ACCESS_KEY}" \
-keywords porcupine
```
The engine starts processing the audio input from the microphone in realtime and outputs to the terminal when it detects utterances of the word `Porcupine`.
For more information about Go demos go to [demo/go](demo/go).
### Unity Demos
To run the Porcupine Unity demo, import the [Porcupine Unity package](binding/unity/porcupine-3.0.1.unitypackage) into your project, open the PorcupineDemo scene and hit play. To run on other platforms or in the player, go to _File > Build Settings_, choose your platform and hit the `Build and Run` button.
To browse the demo source go to [demo/unity](demo/unity).
### Flutter Demos
To run the Porcupine demo on Android or iOS with Flutter, you must have the [Flutter SDK](https://flutter.dev/docs/get-started/install) installed on your system. Once installed, you can run `flutter doctor` to determine any other missing requirements for your relevant platform. Once your environment has been set up, launch a simulator or connect an Android/iOS device.
Run the `prepare_demo` script from [demo/flutter](./demo/flutter) with a language code to set up the demo in the language of your
choice (e.g. `de` -> German, `ko` -> Korean). To see a list of available languages, run `prepare_demo` without a language code.
```console
dart scripts/prepare_demo.dart ${LANGUAGE}
```
Replace your `AccessKey` in [lib/main.dart](./demo/flutter/lib/main.dart) file:
```dart
final String accessKey = "{YOUR_ACCESS_KEY_HERE}"; // AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
```
Run the following command from [demo/flutter](demo/flutter) to build and deploy the demo to your device:
```console
flutter run
```
### React Native Demos
To run the React Native Porcupine demo app you will first need to set up your React Native environment. For this,
please refer to [React Native's documentation](https://reactnative.dev/docs/environment-setup).
Replace your `AccessKey`, in [`App.tsx`](./demo/react-native/App.tsx) file:
```typescript
_accessKey: string ="${YOUR_ACCESS_KEY_HERE}" // AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
```
Navigate to [demo/react-native](demo/react-native) to run the following commands:
For Android:
```console
yarn android-install # sets up environment
yarn android-run ${LANGUAGE} # builds and deploys to Android
```
For iOS:
```console
yarn ios-install # sets up environment
yarn ios-run ${LANGUAGE} # builds and deploys to iOS
```
Replace `${LANGUAGE}` with the language code of your choice (e.g. de -> German, ko -> Korean).
To see a list of available languages, run the `android-run` or `ios-run` command without a language code.
### Android Demos
Using [Android Studio](https://developer.android.com/studio/index.html), open
[demo/android/Activity](demo/android/Activity) as an Android project, copy your AccessKey into `MainActivity.java`, select the build variant (`Build > Select Build Variant...`) for the desired language and then run the application.
To learn about how to use Porcupine in long-running services go to [demo/android/Service](demo/android/Service).
To learn about how to use Porcupine with Android Speech to Text recognition go to [demo/android/STT](demo/android/STT).
### iOS Demos
The BackgroundService demo runs audio recording in the background, enabling detection of wake word while the application is **not** in focus and remains running in the background.
The ForegroundApp demo runs wake word detection **only** when the application is in focus.
#### BackgroundService Demo
To run the demo, go to [demo/ios/BackgroundService](demo/ios/BackgroundService) and run:
```console
pod install
```
Replace `let accessKey = "${YOUR_ACCESS_KEY_HERE}"` in the file [ViewController.swift](demo/ios/BackgroundService/PorcupineBackgroundServiceDemo/ViewController.swift) with your `AccessKey`.
Then, using [Xcode](https://developer.apple.com/xcode/), open the generated `PorcupineBackgroundServiceDemo.xcworkspace` and run the application.
#### ForegroundApp Demo
To run the foreground application demo:
1) Go to [ForegroundApp](./demo/ios/ForegroundApp) directory. Then run:
```console
pod install
```
2) Open the `PorcupineForegroundAppDemo.xcworkspace` in XCode
3) Replace `let accessKey = "${YOUR_ACCESS_KEY_HERE}"` in the file [ViewController.swift](./demo/ios/ForegroundApp/PorcupineForegroundAppDemo/ViewController.swift) with your `AccessKey`.
4) Go to `Product > Scheme` and select the scheme for the language you would like to demo (e.g. `arDemo` -> Arabic Demo, `deDemo` -> German Demo)
5) Run the demo with a simulator or connected iOS device
The demo allows you to select any of the pre-built keywords for detection. Press start and say the selected keyword.
### Web Demos
#### Vanilla JavaScript and HTML
From [demo/web](demo/web) run the following in the terminal:
```console
yarn
yarn start ${LANGUAGE}
```
(or)
```console
npm install
npm run start ${LANGUAGE}
```
Open `http://localhost:5000` in your browser to try the demo.
#### Angular Demos
From [demo/angular](demo/angular) run the following in the terminal:
```console
yarn
yarn start ${LANGUAGE}
```
(or)
```console
npm install
npm run start ${LANGUAGE}
```
Open `http://localhost:4200` in your browser to try the demo.
#### React Demos
From [demo/react](demo/react) run the following in the terminal:
```console
yarn
yarn start ${LANGUAGE}
```
(or)
```console
npm install
npm run start ${LANGUAGE}
```
Open `http://localhost:3000` in your browser to try the demo.
#### Vue Demos
From [demo/vue](demo/vue) run the following in the terminal:
```console
yarn
yarn start ${LANGUAGE}
```
(or)
```console
npm install
npm run start ${LANGUAGE}
```
Open `http://localhost:8080` in your browser to try the demo.
### NodeJS Demos
Install the demo package:
```console
yarn global add @picovoice/porcupine-node-demo
```
With a working microphone connected to your device run the following in the terminal:
```console
ppn-mic-demo --access_key ${ACCESS_KEY} --keywords porcupine
```
The engine starts processing the audio input from the microphone in realtime and outputs to the terminal when it detects
utterances of `Porcupine`.
For more information about NodeJS demos go to [demo/nodejs](demo/nodejs).
### Rust Demos
This demo opens an audio stream from a microphone and detects utterances of a given wake word.
From [demo/rust/micdemo](demo/rust/micdemo) the following opens the default microphone and detects occurrences of "Picovoice":
```console
cargo run --release -- --access_key ${ACCESS_KEY} --keywords picovoice
```
For more information about Rust demos go to [demo/rust](demo/rust).
### C Demos
The C demo requires [CMake](https://cmake.org/) version 3.4 or higher.
The [Microphone demo](demo/c/porcupine_demo_mic.c) requires [miniaudio](https://github.com/mackron/miniaudio) for accessing microphone audio data.
**Windows Requires [MinGW](http://mingw-w64.org) to build the demo.**
#### Microphone Demo
At the root of the repository, build with:
```console
cmake -S demo/c/. -B demo/c/build && cmake --build demo/c/build --target porcupine_demo_mic
```
#### Linux (x86_64), macOS (x86_64), Raspberry Pi, BeagleBone, and Jetson
List input audio devices with:
```console
./demo/c/build/porcupine_demo_mic --show_audio_devices
```
Run the demo using:
```console
./demo/c/build/porcupine_demo_mic -l ${LIBRARY_PATH} -m lib/common/porcupine_params.pv \
-k resources/keyword_files/${PLATFORM}/porcupine_${PLATFORM}.ppn -t 0.5 \
-d ${AUDIO_DEVICE_INDEX} -a ${ACCESS_KEY}
```
Replace `${LIBRARY_PATH}` with path to appropriate library available under [lib](lib), `${PLATFORM}` with the
name of the platform you are running on (`linux`, `raspberry-pi`, `mac`, `beaglebone`, or `jetson`), `${AUDIO_DEVICE_INDEX}` with
the index of your audio device and `${ACCESS_KEY}` with your `AccessKey`.
#### Windows
List input audio devices with:
```console
.\\demo\\c\\build\\porcupine_demo_mic.exe --show_audio_devices
```
Run the demo using:
```console
.\\demo\\c\\build\\porcupine_demo_mic.exe ^
-l lib/windows/amd64/libpv_porcupine.dll ^
-m lib/common/porcupine_params.pv ^
-k resources/keyword_files/windows/porcupine_windows.ppn ^
-t 0.5 ^
-d ${AUDIO_DEVICE_INDEX} ^
-a ${ACCESS_KEY}
```
Replace `${AUDIO_DEVICE_INDEX}` with the index of your audio device and `${ACCESS_KEY}` with your `AccessKey`.
The demo opens an audio stream and detects utterances of `Porcupine`.
#### File Demo
At the root of the repository, build with:
```console
cmake -S demo/c/. -B demo/c/build && cmake --build demo/c/build --target porcupine_demo_file
```
#### Linux (x86_64), macOS (x86_64), Raspberry Pi, BeagleBone, and Jetson
Run the demo using:
```console
./demo/c/build/porcupine_demo_file -l ${LIBRARY_PATH} -m lib/common/porcupine_params.pv \
-k resources/keyword_files/${PLATFORM}/porcupine_${PLATFORM}.ppn -t 0.5 \
-w resources/audio_samples/multiple_keywords.wav -a ${ACCESS_KEY}
```
Replace `${LIBRARY_PATH}` with path to appropriate library available under [lib](lib), `${PLATFORM}` with the
name of the platform you are running on (`linux`, `raspberry-pi`, `mac`, `beaglebone`, or `jetson`) and `${ACCESS_KEY}` with your `AccessKey`.
#### Windows
Run the demo using:
```console
.\\demo\\c\\build\\porcupine_demo_file.exe ^
-l lib/windows/amd64/libpv_porcupine.dll ^
-m lib/common/porcupine_params.pv ^
-k resources/keyword_files/windows/porcupine_windows.ppn ^
-t 0.5 ^
-w resources/audio_samples/multiple_keywords.wav ^
-a ${ACCESS_KEY}
```
Replace `${ACCESS_KEY}` with your `AccessKey`.
The demo opens up the file and detects utterances of `Porcupine`.
For more information about C demos go to [demo/c](demo/c).
### Microcontroller Demos
There are several projects for various development boards inside the [mcu demo](demo/mcu) folder.
## SDKs
### Python
Install the Python SDK:
```console
pip3 install pvporcupine
```
The SDK exposes a factory method to create instances of the engine:
```python
import pvporcupine
# AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
access_key = "${ACCESS_KEY}"
handle = pvporcupine.create(access_key=access_key, keywords=['picovoice', 'bumblebee'])
```
`keywords` argument is a shorthand for accessing default keyword files shipped with the library. The default keyword
files available can be retrieved via
```python
import pvporcupine
print(pvporcupine.KEYWORDS)
```
If you wish to use a non-default keyword file you need to identify its path:
```python
import pvporcupine
# AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
access_key = "${ACCESS_KEY}"
handle = pvporcupine.create(
access_key=access_key,
keyword_paths=['path/to/non/default/keyword/file'])
```
When initialized, valid sample rate can be obtained using `handle.sample_rate`. The required frame length
(number of audio samples in an input array) is `handle.frame_length`. The object can be used to monitor
incoming audio as follows:
```python
import pvporcupine
# AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
access_key = "${ACCESS_KEY}"
handle = pvporcupine.create(access_key=access_key, keywords=['porcupine'])
def get_next_audio_frame():
pass
while True:
keyword_index = handle.process(get_next_audio_frame())
if keyword_index >= 0:
# Insert detection event callback here
pass
```
Finally, when done be sure to explicitly release the resources using `handle.delete()`.
### .NET
Install the .NET SDK using NuGet or the dotnet CLI:
```console
dotnet add package Porcupine
```
The SDK exposes a factory method to create instances of the engine:
```csharp
using Pv;
const string accessKey = "${ACCESS_KEY}";
var keyword = new List { BuiltInKeyword.PICOVOICE };
Porcupine handle = Porcupine.FromBuiltInKeywords(accessKey, keyword);
```
Using the `FromBuiltInKeywords` constructor allows you to initialize the Porcupine engine to detect any of the free, built-in keywords that come with the library. These built-ins are represented by the `BuiltInKeyword` enum.
If you wish to use a custom keyword file (i.e. a keyword file generated by Picovoice Console, with a `.ppn` extension), you need to specify its path:
```csharp
const string accessKey = "${ACCESS_KEY}";
var keywordPaths = new List {
"/absolute/path/to/keyword/one",
"/absolute/path/to/keyword/two",
... }
Porcupine handle = Porcupine.FromKeywordPaths(accessKey, keywordPaths);
```
When initialized, the required sample rate can be obtained using `handle.SampleRate`. Expected frame length
(number of audio samples in an input array) is `handle.FrameLength`. The object can be used to monitor
incoming audio as below:
```csharp
short[] getNextAudioFrame()
{
// .. get a frame of audio
return audioFrame;
}
while(true)
{
var keywordIndex = handle.Process(getNextAudioFrame())
if(keywordIndex >= 0)
{
// .. Insert detection event callback here
}
}
```
Porcupine will have its resources freed by the garbage collector, but to have resources freed immediately after use,
wrap it in a `using` statement:
```csharp
using(Porcupine handle = Porcupine.FromBuiltInKeywords(
accessKey,
new List { BuiltInKeyword.PICOVOICE }))
{
// .. Porcupine usage here
}
```
### Java
The Porcupine Java binding is available from the Maven Central Repository at `ai.picovoice:porcupine-java:${version}`.
```java
import ai.picovoice.porcupine.*;
// AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
final String accessKey = "${ACCESS_KEY}";
try {
Porcupine handle = new Porcupine.Builder()
.setAccessKey(accessKey)
.setBuiltInKeyword(BuiltInKeyword.PORCUPINE)
.build();
} catch (PorcupineException e) { }
```
The `setBuiltInKeyword()` builder argument is a shorthand for accessing built-in keyword model files shipped with the package.
The list of built-in keywords can be found in the `BuiltInKeyword` enum, and can be retrieved by:
```java
import ai.picovoice.porcupine.*;
for(BuiltInKeyword keyword : BuiltInKeyword.values()) {
System.out.println(keyword.name());
}
```
If you wish to use a custom keyword file (i.e. a keyword file generated by Picovoice Console, with a `.ppn` extension) you need to the file path as demonstrated below:
```java
import ai.picovoice.porcupine.*;
// AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
final String accessKey = "${ACCESS_KEY}";
try {
Porcupine handle = new Porcupine.Builder()
.setAccessKey(accessKey)
.setKeywordPath("path/to/custom/keyword/file")
.build();
} catch (PorcupineException e) { }
```
When initialized, valid sample rate can be obtained using `handle.getSampleRate()`. Expected frame length
(number of audio samples in an input array) is `handle.getFrameLength()`. The object can be used to monitor
incoming audio as below:
```java
short[] getNextAudioFrame() {
// .. get audioFrame
return audioFrame;
}
while(true) {
int keywordIndex = handle.Process(getNextAudioFrame());
if(keywordIndex >= 0) {
// .. detection event logic/callback
}
}
```
Once you're done with Porcupine, ensure you release its resources explicitly:
```java
handle.delete();
```
### Go
To install the Porcupine Go module to your project, use the command:
```console
go get github.com/Picovoice/porcupine/binding/go
```
To create an instance of the engine you first create a Porcupine struct with the configuration parameters for the wake word engine and then make a call to `.Init()`.
```go
import . "github.com/Picovoice/porcupine/binding/go/v2"
porcupine := Porcupine{
AccessKey: "${ACCESS_KEY}", // from Picovoice Console (https://console.picovoice.ai/)
BuiltInKeywords: []BuiltInKeyword{PICOVOICE}}
err := porcupine.Init()
if err != nil {
// handle init fail
}
```
In the above example, we've initialized the engine to detect the built-in wake word "Picovoice". Built-in keywords are constants in the package with the BuiltInKeyword type.
To detect non-default keywords, use `KeywordPaths` parameter instead
```go
porcupine := Porcupine{
AccessKey: "${ACCESS_KEY}", // from Picovoice Console (https://console.picovoice.ai/)
KeywordPaths: []string{"/path/to/keyword.ppn"}}
err := porcupine.Init()
```
When initialized, the valid sample rate is given by `SampleRate`. Expected frame length (number of audio samples in an input array) is given by `FrameLength`. The engine accepts 16-bit linearly-encoded PCM and operates on single-channel audio.
To feed audio into Porcupine, use the `Process` function in your capture loop. You must call `Init()` before calling `Process`.
```go
func getNextFrameAudio() []int16 {
// get audio frame
}
for {
keywordIndex, err := porcupine.Process(getNextFrameAudio())
if keywordIndex >= 0 {
// wake word detected!
}
}
```
When done resources have to be released explicitly.
```go
porcupine.Delete()
```
### Unity
Import the [Porcupine Unity Package](binding/unity/porcupine-3.0.1.unitypackage) into your Unity project.
The SDK provides two APIs:
#### High-Level API
[PorcupineManager](binding/unity/Assets/Porcupine/PorcupineManager.cs) provides a high-level API that takes care of audio recording. This is the quickest way to get started.
The static constructor `PorcupineManager.FromBuiltInKeywords` will create an instance of the `PorcupineManager` using one or more of the built-in keywords.
```csharp
using Pv.Unity;
// AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
string accessKey = "${ACCESS_KEY}";
try {
List keywords = new List(){
Porcupine.BuiltInKeyword.PICOVOICE,
Porcupine.BuiltInKeyword.PORCUPINE
};
PorcupineManager _porcupineManager = PorcupineManager.FromBuiltInKeywords(
accessKey,
keywords,
OnWakeWordDetected);
}
catch (Exception ex)
{
// handle porcupine init error
}
```
To create an instance of PorcupineManager that detects custom keywords, you can use the `PorcupineManager.FromKeywordPaths`
static constructor and provide the paths to the `.ppn` file(s).
```csharp
// AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
string accessKey = "${ACCESS_KEY}";
List keywordPaths = new List(){ "/path/to/keyword.ppn" };
PorcupineManager _porcupineManager = PorcupineManager.FromKeywordPaths(
accessKey,
keywordPaths,
OnWakeWordDetected);
```
Once you have instantiated a PorcupineManager, you can start/stop audio capture and wake word detection by calling:
```csharp
_porcupineManager.Start();
// .. use porcupine
_porcupineManager.Stop();
```
Once the app is done with using PorcupineManager, you can explicitly release the resources allocated to Porcupine:
```csharp
_porcupineManager.Delete();
```
There is no need to deal with audio capture to enable wake word detection with PorcupineManager.
This is because it uses our
[unity-voice-processor](https://github.com/Picovoice/unity-voice-processor/)
Unity package to capture frames of audio and automatically pass it to the wake word engine.
#### Low-Level API
[Porcupine](binding/unity/Assets/Porcupine/Porcupine.cs) provides low-level access to the wake word engine for those who want to incorporate wake word detection into an already existing audio processing pipeline. To create an instance of `Porcupine`, use the `.FromBuiltInKeywords` static constructor.
```csharp
using Pv.Unity;
// AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
string accessKey = "${ACCESS_KEY}";
try
{
List keywords = new List(){
Porcupine.BuiltInKeyword.PORCUPINE,
Porcupine.BuiltInKeyword.PICOVOICE
};
Porcupine _porcupine = Porcupine.FromBuiltInKeywords(
accessKey: accessKey,
keywords: keywords);
}
catch (Exception ex)
{
// handle porcupine init error
}
```
To search for a keyword in audio, you must pass frames of audio to Porcupine using the `Process` function. The `keywordIndex` returned will either be -1 if no detection was made or an integer specifying which keyword was detected.
```csharp
short[] frame = getAudioFrame();
try
{
int keywordIndex = _porcupine.Process(frame);
if (keywordIndex >= 0)
{
// detection made!
}
}
catch (Exception ex)
{
Debug.LogError(ex.ToString());
}
```
For `Process` to work correctly, the provided audio must be single-channel and 16-bit linearly-encoded.
Finally, once you no longer need the wake word engine, you can explicitly release the resources allocated to Porcupine:
```csharp
_porcupine.Dispose();
```
### Flutter
Add the [Porcupine Flutter plugin](https://pub.dev/packages/porcupine) to your pub.yaml.
```yaml
dependencies:
flutter_porcupine: ^
```
The SDK provides two APIs:
#### High-Level API
[PorcupineManager](binding/flutter/lib/porcupine_manager.dart) provides a high-level API that takes care of audio recording. This class is the quickest way to get started.
The static constructor `PorcupineManager.fromBuiltInKeywords` will create an instance of the `PorcupineManager` using one or more of the built-in keywords.
```dart
import 'package:porcupine_flutter/porcupine_manager.dart';
import 'package:porcupine_flutter/porcupine_error.dart';
// AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
final String accessKey = "{ACCESS_KEY}";
void createPorcupineManager() async {
try {
_porcupineManager = await PorcupineManager.fromBuiltInKeywords(
accessKey,
[BuiltInKeyword.PICOVOICE, BuiltInKeyword.PORCUPINE],
_wakeWordCallback);
} on PorcupineException catch (err) {
// handle porcupine init error
}
}
```
To create an instance of PorcupineManager that detects custom keywords, you can use the `PorcupineManager.fromKeywordPaths` static constructor and provide the paths to the `.ppn` file(s).
```dart
// AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
final String accessKey = "{ACCESS_KEY}";
_porcupineManager = await PorcupineManager.fromKeywordPaths(
accessKey,
["/path/to/keyword.ppn"],
_wakeWordCallback);
```
Once you have instantiated a PorcupineManager, you can start/stop audio capture and wake word detection by calling:
```dart
try {
await _porcupineManager.start();
} on PorcupineException catch (ex) {
// deal with either audio exception
}
// .. use porcupine
await _porcupineManager.stop();
```
Once the app is done with using PorcupineManager, be sure you explicitly release the resources allocated to Porcupine:
```dart
await _porcupineManager.delete();
```
There is no need to deal with audio capture to enable wake word detection with PorcupineManager.
This is because it uses [flutter_voice_processor](https://github.com/Picovoice/flutter-voice-processor/) plugin to capture frames of audio and automatically pass it to the wake word engine.
#### Low-Level API
[Porcupine](binding/flutter/lib/porcupine.dart) provides low-level access to the wake word engine for those who want to incorporate wake word detection into an already existing audio processing pipeline.`Porcupine` has `fromBuiltInKeywords` and `fromKeywordPaths` static constructors.
```dart
import 'package:porcupine_flutter/porcupine_manager.dart';
import 'package:porcupine_flutter/porcupine_error.dart';
// AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
final String accessKey = "{ACCESS_KEY}";
void createPorcupine() async {
try {
_porcupine = await Porcupine.fromBuiltInKeywords(
accessKey,
[BuiltInKeyword.PICOVOICE]);
} on PorcupineException catch (err) {
// handle porcupine init error
}
}
```
To search for a keyword in audio, you must pass frames of audio to Porcupine using the `process` function. The `keywordIndex` returned will either be -1 if no detection was made or an integer specifying which keyword was detected.
```dart
List buffer = getAudioFrame();
try {
int keywordIndex = _porcupine.process(buffer);
if (keywordIndex >= 0) {
// detection made!
}
} on PorcupineException catch (error) {
// handle error
}
```
For `process` to work correctly, the provided audio must be single-channel and 16-bit linearly-encoded.
Finally, once you no longer need the wake word engine, be sure to explicitly release the resources allocated to Porcupine:
```dart
_porcupine.delete();
```
### React Native
Install [@picovoice/react-native-voice-processor](https://www.npmjs.com/package/@picovoice/react-native-voice-processor)
and [@picovoice/porcupine-react-native](https://www.npmjs.com/package/@picovoice/porcupine-react-native). The SDK
provides two APIs:
#### High-Level API
[PorcupineManager](binding/react-native/src/porcupine_manager.tsx) provides a high-level API that takes care of
audio recording. This class is the quickest way to get started.
Using the constructor `PorcupineManager.fromBuiltInKeywords` will create an instance of the `PorcupineManager`
using one or more of the built-in keywords.
```javascript
// AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
const accessKey = "${ACCESS_KEY}";
async createPorcupineManager(){
try {
this._porcupineManager = await PorcupineManager.fromBuiltInKeywords(
accessKey,
[BuiltInKeywords.Picovoice, BuiltInKeywords.Porcupine],
detectionCallback,
processErrorCallback);
} catch (err) {
// handle error
}
}
```
To create an instance of PorcupineManager that detects custom keywords, you can use the `PorcupineManager.fromKeywordPaths`
static constructor and provide the paths to the `.ppn` file(s).
```javascript
// AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
const accessKey = "${ACCESS_KEY}";
this._porcupineManager = await PorcupineManager.fromKeywordPaths(
accessKey,
["/path/to/keyword.ppn"],
detectionCallback,
processErrorCallback
);
```
Once you have instantiated a Porcupine manager, you can start/stop audio capture and wake word detection by calling:
```javascript
let didStart = this._porcupineManager.start();
// .. use Porcupine
let didStop = this._porcupineManager.stop();
```
Once the app is done with using PorcupineManager, be sure you explicitly release the resources allocated to Porcupine:
```javascript
this._porcupineManager.delete();
```
There is no need to deal with audio capture to enable wake word detection with PorcupineManager.
This is because it uses [@picovoice/react-native-voice-processor](https://github.com/Picovoice/react-native-voice-processor/)
module to capture frames of audio and automatically pass it to the wake word engine.
#### Low-Level API
[Porcupine](binding/react-native/src/porcupine.tsx) provides low-level access to the wake word engine for those
who want to incorporate wake word detection into an already existing audio processing pipeline. `Porcupine` also has
`fromBuiltInKeywords` and `fromKeywordPaths` static constructors.
```javascript
// AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
const accessKey = "${ACCESS_KEY}";
async createPorcupine(){
try {
this._porcupine = await Porcupine.fromBuiltInKeywords(
accessKey, [BuiltInKeywords.PICOVOICE]);
} catch (err) {
// handle error
}
}
```
To search for a keyword in audio, you must pass frames of audio to Porcupine using the `process` function. The `keywordIndex` returned will either be -1 if no detection was made or an integer specifying which keyword was detected.
```javascript
let buffer = getAudioFrame();
try {
let keywordIndex = await this._porcupine.process(buffer);
if (keywordIndex >= 0) {
// detection made!
}
} catch (e) {
// handle error
}
```
For `process` to work correctly, the provided audio must be single-channel and 16-bit linearly-encoded.
Finally, once you no longer need the wake word engine, be sure to explicitly release the resources allocated to Porcupine:
```javascript
this._porcupine.delete();
```
### Android
To include the package in your Android project, ensure you have included `mavenCentral()` in your top-level `build.gradle` file and then add the following to your app's `build.gradle`:
```groovy
dependencies {
implementation 'ai.picovoice:porcupine-android:${LATEST_VERSION}'
}
```
There are two possibilities for integrating Porcupine into an Android application.
#### High-Level API
[PorcupineManager](binding/android/Porcupine/porcupine/src/main/java/ai/picovoice/porcupine/PorcupineManager.java)
provides a high-level API for integrating Porcupine into Android applications. It manages all activities related to creating
an input audio stream, feeding it into the Porcupine library, and invoking a user-provided detection callback.
```java
import ai.picovoice.porcupine.*;
final String accessKey = "${ACCESS_KEY}"; // AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
final String keywordPath = "/path/to/keyword.ppn"; // path relative to 'assets' folder
try {
PorcupineManager porcupineManager = new PorcupineManager.Builder()
.setAccessKey(accessKey)
.setKeywordPath(keywordPath)
.setSensitivity(0.5f)
.build(context,
new PorcupineManagerCallback() {
@Override
public void invoke(int keywordIndex) {
// detection event logic/callback
}
});
} catch (PorcupineException e) { }
```
Keyword files (`.ppn`) should be placed under the Android project assets folder (`src/main/assets/`).
Sensitivity is the parameter that enables developers to trade miss rate for false alarm. It is a floating point number within
[0, 1]. A higher sensitivity reduces miss rate at cost of increased false alarm rate.
When initialized, input audio can be monitored using `manager.start()`. Stop the manager using by invoking
`manager.stop()`. When done be sure to release the resources using `manager.delete()`.
#### Low-Level API
[Porcupine](binding/android/Porcupine/porcupine/src/main/java/ai/picovoice/porcupine/Porcupine.java) provides a
binding for Android. It can be initialized using:
```java
import ai.picovoice.porcupine.*;
final String accessKey = "${ACCESS_KEY}";
final String keywordPath = "/path/to/keyword.ppn";
try {
Porcupine porcupine = new Porcupine.Builder()
.setAccessKey(accessKey)
.setKeywordPath(keywordPath)
.setSensitivity(0.5f)
.build(context);
} catch (PorcupineException e) { }
```
Once initialized, `porcupine` can be used to monitor incoming audio.
```java
private short[] getNextAudioFrame();
while (true) {
final int keywordIndex = porcupine.process(getNextAudioFrame());
if (keywordIndex != -1) {
// detection event logic/callback
}
}
```
Finally, be sure to explicitly release resources acquired by porcupine as the binding class does not rely on the garbage collector for releasing native resources.
```java
porcupine.delete();
```
### iOS
There are two approaches for integrating Porcupine into an iOS application.
#### High-Level API
[PorcupineManager](binding/ios/PorcupineManager.swift) manages audio recording, passing it into Porcupine, and invoking
the user-provided detection callback.
```swift
let accessKey = "${ACCESS_KEY}" // Obtained from Picovoice Console (https://console.picovoice.ai)
let modelPath: String = ... // Available at lib/common/porcupine_params.pv
let keywordPaths: [String] = ["/path/to/keyword/file/a", "/path/to/keyword/file/b"]
let sensitivities: [Float32] = [0.35, 0.64]
let keywordCallback: ((Int32) -> Void) = { keywordIndex in
// Insert detection event logic
}
let manager = try PorcupineManager(
accessKey: accessKey,
modelPath: modelPath,
keywordPaths: keywordPaths,
sensitivities: sensitivities
onDetection: keywordCallback)
```
When initialized, input audio can be monitored using `manager.start()`. When done be sure to stop the manager using
`manager.stop()`.
#### Low-Level API
[Porcupine.swift](binding/ios/Porcupine.swift) provides low-level access to the wake word engine for those who want to incorporate wake word detection into an already existing audio processing pipeline.
To construct an instance of Porcupine, pass it a keyword.
```swift
import Porcupine
let accessKey = "${ACCESS_KEY}" // Obtained from Picovoice Console (https://console.picovoice.ai)
do {
Porcupine porcupine = try Porcupine(
accessKey: accessKey,
keyword: Porcupine.BuiltInKeyword.picovoice)
} catch { }
```
To search for a keyword in audio, you must pass frames of audio to Porcupine using the `process` function. The `keywordIndex` returned will either be -1 if no detection was made or an integer specifying which keyword was detected.
```swift
func getNextAudioFrame() -> [Int16] {
// .. get audioFrame
return audioFrame;
}
while true {
do {
let keywordIndex = try porcupine.process(getNextAudioFrame())
if keywordIndex >= 0 {
// .. detection made!
}
} catch { }
}
```
Once you're done with Porcupine you can force it to release its native resources rather than waiting for the garbage collector:
```swift
porcupine.delete();
```
### Web
Porcupine is available on modern web browsers (i.e. not Internet Explorer) via [WebAssembly](https://webassembly.org/). Microphone audio is handled via the [Web Audio API](https://developer.mozilla.org/en-US/docs/Web/API/Web_Audio_API) and is abstracted by the WebVoiceProcessor, which also handles downsampling to the correct format. Porcupine is provided pre-packaged as a [Web Worker](https://developer.mozilla.org/en-US/docs/Web/API/Web_Workers_API/Using_web_workers).
Each spoken language is available as a dedicated npm package (e.g. @picovoice/porcupine-web-en-worker). These packages can be used with the @picovoice/web-voice-processor. They can also be used with the Angular, React, and Vue bindings, which abstract and hide the web worker communication details.
#### Vanilla JavaScript and HTML (CDN Script Tag)
```html
const PORCUPINE_MODEL_BASE64 = /* Base64 representation of the `.pv` model file*/;
function keywordDetectionCallback(detection) {
console.log(`Porcupine detected ${detection.label}`);
}
function processErrorCallback(error) {
console.error(error);
}
async function startPorcupine() {
console.log("Porcupine is loading. Please wait...");
const accessKey = "${ACCESS_KEY}" // Obtained from Picovoice Console (picovoice.ai/console/)
let porcupine = await PorcupineWeb.PorcupineWorker.create(
accessKey,
[PorcupineWeb.BuiltInKeyword.Picovoice],
porcupineKeywordCallback,
{ base64: PORCUPINE_MODEL_BASE64 },
);
console.log("Porcupine worker ready!");
console.log("WebVoiceProcessor initializing. Microphone permissions requested ...");
await window.WebVoiceProcessor.WebVoiceProcessor.subscribe(porcupine);
console.log("WebVoiceProcessor ready and listening!");
document.addEventListener("DOMContentLoaded", function () {
startPorcupine();
});
```
#### Vanilla JavaScript and HTML (ES Modules)
Install the web SDK using yarn:
```console
yarn add @picovoice/porcupine-web @picovoice/web-voice-processor
```
(or)
```console
npm install --save @picovoice/porcupine-web @picovoice/web-voice-processor
```
```javascript
import { WebVoiceProcessor } from "@picovoice/web-voice-processor"
import { PorcupineWorker } from "@picovoice/porcupine-web";
const PORCUPINE_MODEL_BASE64 = /* Base64 representation of the `.pv` model file*/;
function keywordDetectionCallback(detection) {
console.log(`Porcupine detected ${detection.label}`);
}
const porcupine = await PorcupineWorker.create(
"${ACCESS_KEY}",
PorcupineWeb.BuiltInKeyword.Porcupine,
keywordDetectionCallback,
{ base64: PORCUPINE_MODEL_BASE64 },
);
console.log("WebVoiceProcessor initializing. Microphone permissions requested ...");
await WebVoiceProcessor.subscribe(porcupine);
console.log("WebVoiceProcessor ready and listening!");
...
// Finished with Porcupine? Release the WebVoiceProcessor and the worker.
if (done) {
await WebVoiceProcessor.unsubscribe(porcupine);
porcupine.release()
porcupine.terminate()
}
```
#### Angular
```console
yarn add @picovoice/porcupine-angular @picovoice/web-voice-processor
```
(or)
```console
npm install @picovoice/porcupine-angular @picovoice/web-voice-processor
```
```typescript
import { Subscription } from "rxjs";
import { PorcupineService } from "@picovoice/porcupine-web-angular";
import {BuiltInKeyword} from '@picovoice/porcupine-web';
import porcupineParams from "${PATH_TO_PORCUPINE_PARAMS_BASE64}";
constructor(private porcupineService: PorcupineService) {
this.keywordSubscription = porcupineService.keyword$.subscribe(
porcupineDetection => {
console.log(`Porcupine Detected "${porcupineDetection.label}"`)
});
this.isLoadedSubscription = porcupineService.isLoaded$.subscribe(
isLoaded => {
console.log(isLoaded);
});
this.isListeningSubscription = porcupineService.isListening$.subscribe(
isListening => {
console.log(isListening);
});
this.errorSubscription = porcupineService.error$.subscribe(
error => {
console.error(error);
});
}
async ngOnInit() {
await this.porcupineService.init(
${ACCESS_KEY},
[BuiltInKeyword.Porcupine],
porcupineModel,
options
).then(() => {
this.porcupineService.start();
});
}
ngOnDestroy() {
this.keywordSubscription.unsubscribe();
this.isLoadedSubscription.unsubscribe();
this.isListeningSubscription.unsubscribe();
this.errorSubscription.unsubscribe();
this.porcupineService.release();
}
```
#### React
```console
yarn add @picovoice/porcupine-react @picovoice/web-voice-processor
```
(or)
```console
npm install @picovoice/porcupine-react @picovoice/web-voice-processor
```
```javascript
import { BuiltInKeyword } from '@picovoice/porcupine-web';
import { usePorcupine } from '@picovoice/porcupine-react';
function App(props) {
const {
wakeWordDetection,
isLoaded,
isListening,
error,
init,
start,
stop,
release,
} = usePorcupine();
const initEngine = async () => {
await init(
${ACCESS_KEY},
[BuiltInKeyword.Porcupine],
porcupineModel
);
await start();
}
useEffect(() => {
if (wakeWordDetection !== null) {
console.log(wakeWordDetection.label);
}
}, [wakeWordDetection])
}
```
#### Vue
```console
yarn add @picovoice/porcupine-vue @picovoice/web-voice-processor
```
(or)
```console
npm install @picovoice/porcupine-vue @picovoice/web-voice-processor
```
```vue
import { BuiltInKeyword } from '@picovoice/porcupine-web';
import { usePorcupine } from '@picovoice/porcupine-vue';
import porcupineParams from "${PATH_TO_PORCUPINE_PARAMS_BASE64}"
// Use Vue.extend for JavaScript
export default {
data() {
const {
state,
init,
start,
stop,
release
} = usePorcupine();
init(
${ACCESS_KEY},
[BuiltInKeyword.Porcupine],
{ base64: porcupineParams }, // porcupine model
);
return {
state,
start,
stop,
release
}
},
watch: {
"state.keywordDetection": function (keyword) {
if (keyword !== null) {
console.log(keyword.label);
}
},
"state.isLoaded": function (isLoaded) {
console.log(isLoaded)
},
"state.isListening": function (isListening) {
console.log(isListening)
},
"state.error": function (error) {
console.error(error)
},
},
onBeforeDestroy() {
this.release();
},
};
```
### NodeJS
Install NodeJS SDK:
```console
yarn add @picovoice/porcupine-node
```
Create instances of the Porcupine class by specifying which keywords you want it to listen for:
```javascript
const {
Porcupine,
BuiltinKeyword,
}= require("@picovoice/porcupine-node");
// Obtained from the Picovoice Console (https://console.picovoice.ai/)
const accessKey = "${ACCESS_KEY}";
let handle = new Porcupine(
accessKey,
[BuiltinKeyword.GRASSHOPPER, BuiltinKeyword.BUMBLEBEE],
[0.5, 0.65]);
```
`GRASSHOPPER` and `BUMBLEBEE` are built-in keywords. If you wish to use a custom keyword file, you need to identify its path:
```javascript
const Porcupine = require("@picovoice/porcupine-node");
// Obtained from the Picovoice Console (https://console.picovoice.ai/)
const accessKey = "${ACCESS_KEY}";
let handle = new Porcupine(
accessKey,
["/path/to/custom/keyword/file"],
[0.5]);
```
When instantiated, `handle` can process audio via its `.process` method.
```javascript
let getNextAudioFrame = function() {
...
};
while (true) {
let keywordIndex = handle.process(getNextAudioFrame());
if (keywordIndex !== -1) {
// detection event callback
}
}
```
When done be sure to release resources acquired by WebAssembly using `release()`:
```javascript
handle.release();
```
### Rust
First you will need [Rust and Cargo](https://rustup.rs/) installed on your system.
To add the porcupine library into your app, add `pv_porcupine` to your apps `Cargo.toml` manifest:
```toml
[dependencies]
pv_porcupine = "*"
```
To create an instance of the engine you first create a `PorcupineBuilder` instance with the configuration parameters for the wake word engine and then make a call to `.init()`:
```rust
use porcupine::{BuiltinKeywords, PorcupineBuilder};
// AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
let access_key = "${ACCESS_KEY}";
let porcupine: Porcupine = PorcupineBuilder::new_with_keywords(
access_key,
&[BuiltinKeywords::Porcupine]
)
.init()
.expect("Unable to create Porcupine");
```
In the above example, we've initialized the engine to detect the built-in wake word "Porcupine".
Built-in keywords are contained in the package with the `BuiltinKeywords` enum type.
To detect custom keywords, use `PorcupineBuilder`'s `new_with_keyword_paths` method to pass in `*.ppn` file paths instead:
```rust
let porcupine: Porcupine = PorcupineBuilder::new_with_keyword_paths(
&["/absolute/path/to/keyword/one.ppn",
"/absolute/path/to/keyword/two.ppn"]
)
.init()
.expect("Unable to create Porcupine");
```
When initialized, the valid sample rate is given by `sample_rate()`.
Expected frame length (number of audio samples in an input array) is given by `frame_length()`.
The engine accepts 16-bit linearly-encoded PCM and operates on single-channel audio.
To feed audio into Porcupine, use the `process` function in your capture loop:
```rust
fn next_audio_frame() -> Vec {
// get audio frame
}
loop {
if let Ok(keyword_index) = porcupine.process(&next_audio_frame()) {
if keyword_index >= 0 {
// wake word detected!
}
}
}
```
### C
Porcupine is implemented in ANSI C and therefore can be directly linked to C applications.
[include/pv_porcupine.h](include/pv_porcupine.h) header file contains relevant information. An instance of Porcupine
object can be constructed as follows.
```c
// Available at lib/common/porcupine_params.pv
const char *model_path = ...
// AccessKey obtained from Picovoice Console (https://console.picovoice.ai/)
const char *access_key = ...
const char *keyword_path = ...
const float sensitivity = 0.5f;
pv_porcupine_t *handle = NULL;
const pv_status_t status = pv_porcupine_init(
access_key,
model_path,
1,
&keyword_path,
&sensitivity,
&handle);
if (status != PV_STATUS_SUCCESS) {
// Insert error handling logic
}
```
Sensitivity is the parameter that enables developers to trade miss rate for false alarm. It is a floating point number
within [0, 1]. A higher sensitivity reduces miss rate (false reject rate) at cost of (potentially) increased false alarm
rate.
Now the `handle` can be used to monitor incoming audio stream. Porcupine accepts single channel, 16-bit linearly-encoded
PCM audio. The sample rate can be retrieved using `pv_sample_rate()`. Finally, Porcupine accepts input audio in
consecutive chunks (aka frames) the length of each frame can be retrieved using `pv_porcupine_frame_length()`.
```c
extern const int16_t *get_next_audio_frame(void);
while (true) {
const int16_t *pcm = get_next_audio_frame();
int32_t keyword_index = -1;
const pv_status_t status = pv_porcupine_process(handle, pcm, &keyword_index);
if (status != PV_STATUS_SUCCESS) {
// error handling logic
}
if (keyword_index != -1) {
// Insert detection event callback
}
}
```
Finally, when done be sure to release the acquired resources:
```c
pv_porcupine_delete(handle);
```
### Microcontroller
Porcupine is implemented in ANSI C and therefore can be directly linked to embedded C projects. Its public header file contains relevant information. An instance of the Porcupine object can be constructed as follows.
```c
#define MEMORY_BUFFER_SIZE ...
uint8_t memory_buffer[MEMORY_BUFFER_SIZE] __attribute__((aligned(16)));
// AccessKey string obtained from Picovoice Console (https://console.picovoice.ai/)
static const char* ACCESS_KEY = ...
const uint8_t keyword_array[] = {...};
const int32_t keyword_model_sizes = sizeof(keyword_array);
const void *keyword_models = keyword_array;
const float sensitivity = 0.5f;
pv_porcupine_t *handle = NULL;
const pv_status_t status = pv_porcupine_init(
ACCESS_KEY,
MEMORY_BUFFER_SIZE,
memory_buffer,
1,
&keyword_model_sizes,
&keyword_models,
&sensitivity,
&handle);
if (status != PV_STATUS_SUCCESS) {
// error handling logic
}
```
Sensitivity is the parameter that enables developers to trade miss rate for false alarm. It is a floating-point number
within [0, 1]. A higher sensitivity reduces miss rate (false reject rate) at cost of increased false alarm rate.
Now the `handle` can be used to monitor incoming audio stream. Porcupine accepts single channel, 16-bit PCM audio. The
sample rate can be retrieved using `pv_sample_rate()`. Finally, Picovoice accepts input audio in consecutive chunks (aka
frames) the length of each frame can be retrieved using `pv_porcupine_frame_length()`.
```c
extern const int16_t *get_next_audio_frame(void);
while (true) {
const int16_t *pcm = get_next_audio_frame();
int32_t keyword_index;
const pv_status_t status = pv_porcupine_process(handle, pcm, &keyword_index);
if (status != PV_STATUS_SUCCESS) {
// error handling logic
}
if (keyword_index != -1) {
// detection event logic/callback
}
}
```
Finally, when done be sure to release the acquired resources.
```c
pv_porcupine_delete(handle);
```
## Releases
### v3.0.0 - October 26th, 2023
- Improvements to error reporting
- Upgrades to authorization and authentication system
- Various bug fixes and improvements
- Added Farsi support for microcontrollers
- Node min support bumped to 16
- Unity editor min support bumped to 2021
- Patches to .NET support
### v2.2.0 - April 12th, 2023
- Added language support for Arabic, Dutch, Hindi, Mandarin, Polish, Russian, Swedish and Vietnamese
- Added support for .NET 7.0 and fixed support for .NET Standard 2.0
- iOS minimum support moved to 11.0
- Improved stability and performance
### v2.1.0 - January 20th, 2022
- Added macOS arm64 (Apple Silicon) support for Java and Unity SDKs
- Various bug fixes and improvements
### v2.0.0 - Nov 25th, 2021
- Improved accuracy
- Added Rust SDK
- macOS arm64 support
- Added NodeJS support for Windows, NVIDIA Jetson Nano, and BeagleBone
- Added .NET support for NVIDIA Jetson Nano and BeagleBone
- Runtime optimization
### v1.9.0 - December 2nd, 2020
- Added React Native SDK
- Added Java SDK
- Added .NET SDK
- Added NodeJS SDK
- Improved accuracy
- Runtime optimization
### v1.8.0 - May 27th, 2020
- Improved accuracy
- Runtime optimization
### v1.7.0 - Feb 13th, 2020
- Improved accuracy
- Runtime optimization
- Added support for Raspberry Pi 4
- Added service-based Android demo application
- Added C demo applications
- Updated documentation
### v1.6.0 - April 25th, 2019
- Improved accuracy
- Runtime optimization
- Added support for BeagleBone
- iOS build can run on simulator now
### v1.5.0 - November 13, 2018
- Improved accuracy
- Runtime optimization
- Added support for running within web browsers (WebAssembly)
### v1.4.0 - July 20, 2018
- Improved accuracy
- Runtime optimizations.
- Updated documentation
### v1.3.0 - June 19, 2018
- Improved accuracy
- Runtime optimizations
### v1.2.0 - April 21, 2018
- Runtime optimizations
### v1.1.0 - April 11, 2018
- Added multiple command detection capability
### v1.0.0 - March 13, 2018
- Initial release
## FAQ
You can find the FAQ [here](https://picovoice.ai/docs/faq/porcupine/).