https://github.com/olilarkin/iplug2onnxruntime
ML Audio plug-in example using iPlug2 & ONNX Runtime
https://github.com/olilarkin/iplug2onnxruntime
audiounit auv3 ios iplug2 machine-learning onnxruntime vst
Last synced: about 1 year ago
JSON representation
ML Audio plug-in example using iPlug2 & ONNX Runtime
- Host: GitHub
- URL: https://github.com/olilarkin/iplug2onnxruntime
- Owner: olilarkin
- Created: 2023-01-31T22:45:16.000Z (over 3 years ago)
- Default Branch: master
- Last Pushed: 2023-12-02T23:44:18.000Z (over 2 years ago)
- Last Synced: 2025-04-05T14:34:38.624Z (about 1 year ago)
- Topics: audiounit, auv3, ios, iplug2, machine-learning, onnxruntime, vst
- Language: Python
- Homepage:
- Size: 441 KB
- Stars: 32
- Watchers: 5
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# iPlug2OnnxRuntime
Machine Learning Audio plug-in/App example using [iPlug2](https://github.com/iPlug2/iPlug2) and [Microsoft ONNX Runtime](https://github.com/microsoft/onnxruntime).
This example processes an LSTM Neural Network Model trained using Steve Atkinson's [Neural Amp Modeler](https://github.com/sdatkinson/neural-amp-modeler). The C++ code to run this model is found in [LSTMModelInference.h](iPlug2OnnxRuntime/LSTMModelInference.h). The model itself is in `ort-builder/model.onnx`, and converted to .ort format and serialized to a bin2c resource in `ort-builder/model/model.ort.h`. The project links to customised ONNX Runtime static libs which are pruned to contain only the operators and types required for a particular model, only including support for inference using the CPU. ORT is linked statically to make the audio plug-in more portable. These libs are created with a separate repo [ort-builder](https://github.com/olilarkin/ort-builder/), which can be used to customize the libs for your model, and to add support for e.g. GPU inference.
It should compile for macOS, iOS and Windows.
For Windows, you'll need to unzip the onnxruntime.lib in `/ort-builder/libs/win-x86_64/MinSizeRel`. If you need to build the Debug target, you'll need
to compile the debug build of onnxruntime.lib (not included due to its size).
License: MIT
