Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with onnxruntime

A curated list of projects in awesome lists tagged with onnxruntime .

https://github.com/xlite-dev/lite.ai.toolkit

🛠 A lite C++ AI toolkit: 100+🎉 models (Stable-Diffusion, Face-Fusion, YOLO series, Det, Seg, Matting) with MNN, ORT and TRT.

facefusion mnn mnn-model ncnn onnx onnxruntime robustvideomatting stable-diffusion tensorrt tnn yolov5 yolov6 yolov8 yolox

Last synced: 13 May 2025

https://github.com/rapidai/rapidocr

📄 Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVINO, PaddlePaddle and PyTorch.

chineseocr crnn dbnet easyocr ocr onnxocr onnxruntime openvino paddleocr rapidocr rapidocronnxruntime

Last synced: 14 May 2025

https://github.com/deftruth/lite.ai.toolkit

🛠 A lite C++ toolkit of 100+ Awesome AI models, support ORT, MNN, NCNN, TNN and TensorRT. 🎉🎉

facefusion mnn mnn-model ncnn onnx onnxruntime robustvideomatting stable-diffusion tensorrt tnn yolov5 yolov6 yolov8 yolox

Last synced: 20 Mar 2025

https://github.com/DefTruth/lite.ai.toolkit

🛠 A lite C++ toolkit of 100+ Awesome AI models, support ORT, MNN, NCNN, TNN and TensorRT. 🎉🎉

facefusion mnn mnn-model ncnn onnx onnxruntime robustvideomatting stable-diffusion tensorrt tnn yolov5 yolov6 yolov8 yolox

Last synced: 20 Mar 2025

https://github.com/royshil/obs-backgroundremoval

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.

background-segmentation computer-vision image-segmentation libobs mac-osx obs obs-plugin obs-studio obs-studio-plugin obsproject onnx onnx-runtime onnxruntime onnxruntime-gpu plugin video-segmentation

Last synced: 10 Jun 2025

https://github.com/locaal-ai/obs-backgroundremoval

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.

background-segmentation computer-vision image-segmentation libobs mac-osx obs obs-plugin obs-studio obs-studio-plugin obsproject onnx onnx-runtime onnxruntime onnxruntime-gpu plugin video-segmentation

Last synced: 13 May 2025

https://github.com/paddlepaddle/fastdeploy

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

android graphcore intel jetson kunlun object-detection onnx onnxruntime openvino picodet rockchip serving stable-diffusion tensorrt uie yolov5 yolov8

Last synced: 23 Jan 2026

https://github.com/PaddlePaddle/FastDeploy

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

android graphcore intel jetson kunlun object-detection onnx onnxruntime openvino picodet rockchip serving stable-diffusion tensorrt uie yolov5 yolov8

Last synced: 20 Mar 2025

https://github.com/RapidAI/RapidOCR

Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVION and PaddlePaddle. （将PaddleOCR模型做了转换，采用ONNXRuntime推理，速度很快）

chineseocr crnn dbnet easyocr ocr onnxocr onnxruntime openvino paddleocr rapidocr

Last synced: 20 Mar 2025

https://github.com/huggingface/optimum

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

graphcore habana inference intel onnx onnxruntime optimization pytorch quantization tflite training transformers

Last synced: 14 May 2025

https://github.com/menloresearch/cortex.cpp

Local AI API Platform

gguf llamacpp onnx onnxruntime

Last synced: 14 May 2025

https://github.com/remsky/kokoro-fastapi

Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching

fastapi huggingface-spaces kokoro kokoro-tts onnx onnxruntime openai-compatible-api openwebui pytorch sillytavern tts tts-api uv

Last synced: 15 May 2026

https://github.com/ppogg/yolov5-lite

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

android-app mnn mobilenet ncnn onnxruntime openvivo picodet pplcnet pytorch repvgg shufflenetv2 tensorrt tflite transformer yolov5

Last synced: 15 May 2025

https://github.com/ppogg/YOLOv5-Lite

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

android-app mnn mobilenet ncnn onnxruntime openvivo picodet pplcnet pytorch repvgg shufflenetv2 tensorrt tflite transformer yolov5

Last synced: 20 Mar 2025

https://github.com/janhq/cortex.cpp

Local AI API Platform

gguf llamacpp onnx onnxruntime tensorrt-llm

Last synced: 18 Jan 2026

https://github.com/lemonade-sdk/lemonade

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

ai amd genai gpu llama llm llm-inference local-server mcp mcp-server mistral npu onnxruntime openai-api qwen radeon rocm ryzen vulkan

Last synced: 02 Apr 2026

https://github.com/thewh1teagle/kokoro-onnx

TTS with kokoro and onnx runtime

kokoro onnxruntime python tts

Last synced: 29 Dec 2025

https://github.com/ricky0123/vad

Voice activity detector (VAD) for the browser with a simple API

onnxruntime silero-vad speech-to-text typescript voice-activity-detection web web-audio-api

Last synced: 01 Mar 2026

https://github.com/pykeio/ort

Fast ML inference & training for ONNX models in Rust

ai ai-training fine-tuning inference machine-learning onnx onnxruntime rust

Last synced: 19 Oct 2025

https://github.com/microsoft/ai-dev-gallery

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

ai csharp developer-tools directml dotnet genai mistral npu onnx onnxruntime onnxruntime-genai phi3 qnn stable-diffusion visual-studio whisper winappsdk windows winui3 wpf

Last synced: 14 May 2025

https://github.com/NaruseMioShirakana/DragonianVoice

一个使用C++编写的音频处理软件

diffsinger diffsvc hifigan onnxruntime pytorch sovits tacotron2 tts vits

Last synced: 31 Mar 2025

https://github.com/redisai/redis-inference-optimization

A Redis module for serving tensors and executing deep learning graphs

machine-learning onnxruntime pytorch redisai serving-tensors tensorflow

Last synced: 06 Oct 2025

https://github.com/RedisAI/redis-inference-optimization

A Redis module for serving tensors and executing deep learning graphs

machine-learning onnxruntime pytorch redisai serving-tensors tensorflow

Last synced: 26 Mar 2025

https://github.com/remsky/Kokoro-FastAPI

Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching

fastapi huggingface-spaces kokoro kokoro-tts onnx onnxruntime pytorch tts tts-api

Last synced: 05 Oct 2025

https://github.com/zhiqwang/yolort

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

deployment detection graghsurgeon inference jit libtorch lightning ncnn nms onnx onnxruntime pytorch tensorrt torchscript trt tvm visualization yolo yolort yolov5

Last synced: 15 May 2025

https://github.com/rnchg/APT

AI Productivity Tool - Free and open source, improve user productivity, and protect privacy and data security. Including but not limited to: built-in local exclusive ChatGPT, DeepSeek, Phi, Qwen and other models, one-click batch intelligent processing of pictures, videos, audio, etc.

ai ai-framework aigc audio-processing chatgpt computer-vision deep-learning deepseek generative-ai image-processing inference llm machine-learning machinelearning neural-network onnx onnxruntime video-processing

Last synced: 14 Aug 2025

https://github.com/rnchg/apt

AI Productivity Tool - Free and open source, improve user productivity, protect privacy and data security. Provide efficient and convenient AI solutions, built-in local exclusive ChatGPT, Phi, DeepSeek, one-click batch intelligent processing of pictures, videos, audio, etc.

ai ai-framework aigc audio-processing chatgpt computer-vision deep-learning deepseek generative-ai image-processing inference llm machine-learning machinelearning neural-network onnx onnxruntime video-processing

Last synced: 15 May 2025

https://github.com/rnchg/Apt

AI Productivity Tool - Free and open source, improve user productivity, protect privacy and data security. Provide efficient and convenient AI solutions, built-in local exclusive ChatGPT, Phi, DeepSeek, one-click batch intelligent processing of pictures, videos, audio, etc.

ai ai-framework aigc audio-processing chatgpt computer-vision deep-learning deepseek generative-ai image-processing inference llm machine-learning machinelearning neural-network onnx onnxruntime video-processing

Last synced: 24 Mar 2025

https://github.com/stochasticai/x-stable-diffusion

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6

aitemplate automl cuda docker inference notebook nvfuser onnx onnxruntime pytorch stable-diffusion tensorrt

Last synced: 04 Apr 2025

https://github.com/yakhyo/uniface

UniFace: An All-in-One Open-Source Face Analysis Library - Face Detection, Face Recognition, Landmark Localization, Face Parsing, Gaze Estimation, and Attribute Estimation (Age, Gender, Race)

age-gender-estimation arcface face-alignment face-analysis face-detection face-emotion-detection face-landmark-detection face-mask face-parsing face-recognition face-segmentation gaze-estimation headpose-estimation onnxruntime retinaface scrfd sphereface yoloface

Last synced: 14 Feb 2026

https://github.com/kazuhito00/image-processing-node-editor

処理の検証や比較検討での用途を想定したノードエディターベースの画像処理アプリ(A node editor-based image processing application intended for use in processing verification and comparison studies)

dearpygui image-processing-node-editor node-editor onnx onnxruntime opencv

Last synced: 04 Apr 2025

https://github.com/ibaiGorordo/ONNX-YOLOv8-Object-Detection

Python scripts performing object detection using the YOLOv8 model in ONNX.

computer-vision deep-learning object-detection onnx onnxruntime opencv python yolo yolov8

Last synced: 21 Apr 2025

https://github.com/azkadev/ntts

Neural Text To Speech Di Dart Cepat Ringan Tanpa Koneksi Internet dan bisa berjalan di cpu

ai android cpu dart flutter home-assistant indonesia ios linux macos ml natural-text-to-speech ntts onnxruntime scifi speech-synthesis text-to-speech tts web windows

Last synced: 06 Apr 2025

https://github.com/yalue/onnxruntime_go

A Go (golang) library wrapping microsoft/onnxruntime.

arm64 go golang linux neural-networks onnx onnxruntime windows

Last synced: 20 Aug 2025

https://github.com/tpoisonooo/llama.onnx

LLaMa/RWKV onnx models, quantization and testcase

alpaca llama llm onnx onnxruntime quantization rwkv transformer

Last synced: 07 Apr 2025

https://github.com/fabio-sim/Depth-Anything-ONNX

ONNX-compatible Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data

deep-learning depth depth-anything depth-estimation machine-learning monocular-depth-estimation onnx onnxruntime pytorch

Last synced: 19 Apr 2026

https://github.com/huggingface/optimum-benchmark

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

benchmark neural-compressor onnxruntime openvino pytorch tensorrt-llm text-generation-inference

Last synced: 14 Oct 2025

https://github.com/fabio-sim/depth-anything-onnx

ONNX-compatible Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data

deep-learning depth depth-anything depth-estimation machine-learning monocular-depth-estimation onnx onnxruntime pytorch

Last synced: 03 Apr 2025

https://github.com/nbigaouette/onnxruntime-rs

Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

inference onnx onnx-runtime onnxruntime onnxruntime-sys rust rust-wrapper

Last synced: 21 Apr 2025

https://github.com/axodox/unpaint

A simple Windows / Xbox app for generating AI images with Stable Diffusion.

ai cpp directml image-generation inpaint native onnx onnxruntime stable-diffusion uwp windows winui

Last synced: 09 Apr 2025

https://github.com/ar-ray-code/yolox-ros

YOLOX + ROS2 object detection package (C++ only support)

humble object-detection onnxruntime opencv openvino ros2 tensorrt tflite yolox

Last synced: 03 Jan 2026

https://github.com/Ar-Ray-code/YOLOX-ROS

YOLOX + ROS2 object detection package (C++ only support)

humble object-detection onnxruntime opencv openvino ros2 tensorrt tflite yolox

Last synced: 18 Mar 2025

https://github.com/abelriboulot/onnxt5

Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.

inference nlp nlp-machine-learning onnx onnxruntime sentiment-analysis summarization text-classification text-generation transformer transformers translation

Last synced: 12 Apr 2025

https://github.com/AmusementClub/vs-mlrt

Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet and more!)

artificial-intelligence cuda deep-learning directml dpir gpu migraphx ncnn neural-network onnx onnxruntime openvino real-cugan real-esrgan rife tensorrt vapoursynth vulkan waifu2x

Last synced: 24 Mar 2025

https://github.com/cassiebreviu/stablediffusion

Inference Stable Diffusion with C# and ONNX Runtime

csharp onnx onnxruntime stable-diffusion

Last synced: 05 Apr 2025

https://github.com/cansik/onnxruntime-silicon

ONNX Runtime prebuilt wheels for Apple Silicon (M1 / M2 / M3 / ARM64)

apple macos onnx onnxruntime silicon

Last synced: 04 Jul 2025

https://github.com/dev-diaries41/smartscan

SmartScan is an innovative app that automatically organizes your images by content similarity and enables text-based media search.

android android-app few-shot-learning image-classification jetpack-compose kotlin ml ondevicemachinelearning onnx onnxruntime similarity-search text-to-image-search vector-embeddings

Last synced: 23 Jun 2025

https://github.com/hpc203/bytetrack-opencv-onnxruntime

分别使用OpenCV、ONNXRuntime部署YOLOX+ByteTrack目标跟踪，包含C++和Python两个版本的程序

bytetrack object-tracking onnxruntime opencv-dnn yolox

Last synced: 20 Mar 2025

https://github.com/elixir-nx/ortex

ONNX Runtime bindings for Elixir

elixir machine-learning onnx onnxruntime rust

Last synced: 10 Oct 2025

https://github.com/hpc203/yolov7-opencv-onnxrun-cpp-py

分别使用OpenCV、ONNXRuntime部署YOLOV7目标检测，一共包含14个onnx模型，依然是包含C++和Python两个版本的程序

cpp onnxruntime opencv-dnn python yolov7

Last synced: 20 Mar 2025

https://github.com/pykeio/diffusers

A modular Rust library for super fast Stable Diffusion inference - 45% faster than PyTorch 🔮

cuda diffusion-models onnx onnxruntime onnxruntime-gpu rust stable-diffusion stable-diffusion-v2

Last synced: 28 Mar 2025

https://github.com/jason-li-831202/Vehicle-CV-ADAS

The project can achieve FCWS, LDWS, and LKAS functions solely using only visual sensors. using YOLOv5 / YOLOv5-lite / YOLOv6 / YOLOv7 / YOLOv8 / YOLOv9 / EfficientDet and Ultra-Fast-Lane-Detection-v2 .

bytetrack efficientdet fcws lane-detection ldws lkas object-detection onnxruntime python pytorch tensorrt ultra-fast-lane-detection-v2 yolov10 yolov5 yolov5-lite yolov6 yolov7 yolov8 yolov9

Last synced: 21 Apr 2025

https://github.com/oracle/sd4j

Stable diffusion pipeline in Java using ONNX Runtime

java onnxruntime stable-diffusion

Last synced: 04 Apr 2025

https://github.com/kibae/onnxruntime-server

ONNX Runtime Server: The ONNX Runtime Server is a server that provides TCP and HTTP/HTTPS REST APIs for ONNX inference.

ai contributions-welcome cuda deep-learning inference-server machine-learning nueral-networks onnx onnxruntime

Last synced: 05 Apr 2025

https://github.com/UNeedCryDear/yolov5-seg-opencv-onnxruntime-cpp

yolov5 segmentation with onnxruntime and opencv

onnxruntime opencv yolov5-seg

Last synced: 20 Apr 2025

https://github.com/jamjamjon/usls

A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models.

clip cuda florence2 grounding-dino imshow moondream ocr onnx onnxruntime rust-yolo sam sapiens smolvlm tensorrt yolo yolo-rs yolo-rust yolov10 yolov11 yolov8

Last synced: 16 May 2025

https://github.com/xlite-dev/RVM-Inference

🔥Robust Video Matting C++ inference toolkit with ONNXRuntime、MNN、NCNN and TNN, via lite.ai.toolkit.

cpp matting mnn ncnn onnx onnxruntime robustvideomatting tnn

Last synced: 09 Oct 2025

https://github.com/llmkira/vitsserver

🌻 VITS ONNX TTS server designed for fast inference 🔥

onnx onnxruntime so-vits-svc tts tts-api vits

Last synced: 05 Apr 2025

https://github.com/patil-suraj/onnx_transformers

Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.

inference nlp onnx onnxruntime transformers

Last synced: 15 Apr 2025

https://github.com/ibaigorordo/onnx-mobile-human-pose-3d

Python scripts for performing 3D human pose estimation using the Mobile Human Pose model in ONNX.

3d-pose-estimation onnx onnxruntime pose-estimation yolov5s

Last synced: 28 Jun 2025

https://github.com/AlekseyKorshuk/optimum-transformers

Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.

benchmark huggingface infinity natural-language-processing nlp onnx onnxruntime optimum pipeline transformers

Last synced: 19 Jul 2025

https://github.com/ibaiGorordo/ONNX-CREStereo-Depth-Estimation

Python scripts performing stereo depth estimation using the CREStereo model in ONNX.

computer-vision crestereo depth-estimation onnx onnxruntime opencv python stereo-depth-estimation stereo-matching stereo-vision

Last synced: 20 Mar 2025

https://github.com/miuda-ai/lele

Bare-Metal Rust Audio AI Framework

audio onnxruntime pytorch

Last synced: 13 Feb 2026

https://github.com/ibaiGorordo/ONNX-Mobile-Human-Pose-3D

Python scripts for performing 3D human pose estimation using the Mobile Human Pose model in ONNX.

3d-pose-estimation onnx onnxruntime pose-estimation yolov5s

Last synced: 20 Jul 2025

https://github.com/gtbluesky/onnxruntime_flutter

A flutter plugin for OnnxRuntime provides an easy, flexible, and fast Dart API to integrate Onnx models in flutter apps across mobile and desktop platforms.

dart ffi flutter onnx onnxruntime pytorch tensorflow

Last synced: 05 Apr 2025

https://github.com/Torsion-Audio/nn-inference-template

Neural network inference template for real-time cricital audio environments - presented at ADC23

audio audio-plugin deep-learning inference inference-engine juce libtorch machine-learning neural-network onnx onnxruntime pytorch tensorflow tensorflow-lite

Last synced: 08 May 2025

https://github.com/bluemirrors/cvu

Computer Vision deployment tools for dummies and experts. CVU aims at making CV pipelines easier to build and consistent around platforms, devices, and models.

computer-vision object-detection onnxruntime pytorch tensorflow2 tensorrt yolov5

Last synced: 08 May 2025

https://github.com/adalkiran/distributed-inference

A project to demonstrate an approach to designing cross-language and distributed pipeline in deep learning/machine learning domain, using WebRTC and Redis Streams.

cross-language deep-learning distributed distributed-systems go golang machine-learning ml mlops onnx onnxruntime pion python redis redis-streams video-processing video-processing-pipeline webrtc yolo yolox

Last synced: 04 Apr 2026

https://github.com/asus4/onnxruntime-unity

ONNX Runtime Plugin for Unity

onnxruntime unity

Last synced: 29 Dec 2025

https://github.com/manyeyes/manyspeech

AI Speech Solutions for Tasks such as ASR, Vocal Extraction, Accompaniment Extraction, Audio Denoising, and Enhancement, Support models such as paraformer, sensevoice, fireredasr, zipformer, moonshine, wenet, whisper, fsmn-vad, silero-vad, CT Transformer punc, Spleeter, Uvr5, etc, apply ONNX models in various scenarios.

asr ct-transformer-punc fireredasr fsmn-vad maui moonshine onnx onnxruntime paraformer sensevoice silero-vad speech-recognition speech-to-text spleeter uvr5 wenet whisper zipformer

Last synced: 06 Jun 2026

https://github.com/DanielSarmiento04/yolov10cpp

Implementation of yolo v10 in c++ std 17 over opencv and onnxruntime

cmake object-detection onnxruntime opencv-cpp yolov10

Last synced: 21 Apr 2025

https://github.com/ppogg/yolo-streaming

Push-pull streaming and Web display of YOLO series

dnn flask onnxruntime stream web yolov3 yolov4 yolov5 yolox

Last synced: 08 Jul 2025

https://github.com/asus4/onnxruntime-unity-examples

Examples for ONNX Runtime Unity Plugin

onnxruntime unity

Last synced: 26 Jul 2025

https://github.com/daviddaytw/react-native-transformers

Run local LLM from Huggingface in React-Native or Expo using onnxruntime.

expo huggingface local-llm onnx onnxruntime react-native transformers

Last synced: 06 Apr 2025

https://github.com/gutenye/ocr

High accurate text detection (OCR) Javascript/Typescript library that runs on Node.js, Browser, React Native and C++. Based on PaddleOCR and ONNX runtime

browser cpp javascript node ocr onnxruntime paddleocr react-native text-detection typescript

Last synced: 05 Apr 2025

https://github.com/rapidai/rapidtabledetection

检测和提取各种场景图片中的表格区域，并纠正透视和旋转问题 Detect and extract table regions from images in various scenarios, and correct perspective and rotation issues.

onnxruntime table table-detection table-structure

Last synced: 05 Apr 2025

https://github.com/hpc203/yolopv2-opencv-onnxrun-cpp-py

分别使用OpenCV、ONNXRuntime部署YOLOPV2目标检测+可驾驶区域分割+车道线分割，一共包含54个onnx模型，依然是包含C++和Python两个版本的程序。仅仅只依赖OpenCV就能运行，彻底摆脱对任何深度学习框架的依赖。

autonomous-driving cpp drivable-area-segmentation lane-lines-detection object-detection onnxruntime opencv-dnn python yolopv2

Last synced: 20 Mar 2025

https://github.com/duj12/asr-2pass

ASR 2Pass onnxruntime and websocket server, based on FunASR(https://github.com/alibaba-damo-academy/FunASR).

inverse-text-normalization onnxruntime punctuation-restoration speech-recognition streaming-speech-to-text voice-activity-detection websocket

Last synced: 26 Jul 2025

https://github.com/blace-ai/blace-ai

Cross-platform c++ sdk & model hub for cross-platform AI inference. Ready-to-deploy models including Segment Anything 3, Depth Anything 2 and Gemma.

ai-hub ai-inference ai-sdk cpp libtorch onnxruntime

Last synced: 03 Mar 2026