https://github.com/xybrid-ai/xybrid

Build apps powered by on-device AI
https://github.com/xybrid-ai/xybrid

ai-games edge-ai ios kotlin llamacpp llm mobile-llm ollama on-device-ai on-device-ml onnx-runtime privacy privacy-tools rust swift unity-ai unity3d voice-ai voice-assistant

Last synced: 9 days ago
JSON representation

Build apps powered by on-device AI

Host: GitHub
URL: https://github.com/xybrid-ai/xybrid
Owner: xybrid-ai
License: apache-2.0
Created: 2025-12-13T10:44:50.000Z (6 months ago)
Default Branch: master
Last Pushed: 2026-04-02T00:50:04.000Z (2 months ago)
Last Synced: 2026-04-02T06:26:08.582Z (2 months ago)
Topics: ai-games, edge-ai, ios, kotlin, llamacpp, llm, mobile-llm, ollama, on-device-ai, on-device-ml, onnx-runtime, privacy, privacy-tools, rust, swift, unity-ai, unity3d, voice-ai, voice-assistant
Language: Rust
Homepage: https://xybrid.ai
Size: 460 MB
Stars: 90
Watchers: 1
Forks: 8
Open Issues: 4
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Security: SECURITY.md
- Notice: NOTICE
- Cla: CLA.md

Awesome Lists containing this project

README

          




  English · 简体中文





  



Xybrid




  On-device AI for mobile, desktop, edge.


  Run speech, language, and vision models locally — private, offline, fast.


  Perfect for any app including games 🕹️





  Documentation ·

  SDKs ·

  Models ·

  Join Discord ·

  Issues





[![Website][website-shield]][website-url]

[![Discord][discord-shield]][discord-url]

[![Twitter][twitter-shield]][twitter-url]




[![License][license-shield]][license-url]

[![Build][build-shield]][build-url]

[![Stars][stars-shield]][stars-url]

[![Release][release-shield]][release-url]

[![Release Date][release-date-shield]][release-url]




[![pub.dev][pubdev-shield]][pubdev-url]

[![Maven Central][maven-shield]][maven-url]



[website-shield]: https://img.shields.io/badge/xybrid.ai-4285F4?style=flat

[website-url]: https://www.xybrid.ai/

[discord-shield]: https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fdiscord.com%2Fapi%2Finvites%2FYhFHHkhbad%3Fwith_counts%3Dtrue&query=%24.approximate_member_count&logo=discord&logoColor=white&label=Discord&color=5865F2&suffix=%20members

[discord-url]: https://discord.gg/YhFHHkhbad

[twitter-shield]: https://img.shields.io/twitter/follow/xybrid_ai

[twitter-url]: https://x.com/xybrid_ai

[license-shield]: https://img.shields.io/badge/License-Apache_2.0-blue.svg?style=flat

[license-url]: https://opensource.org/licenses/Apache-2.0

[build-shield]: https://img.shields.io/github/actions/workflow/status/xybrid-ai/xybrid/ci.yml?branch=master&style=flat

[build-url]: https://github.com/xybrid-ai/xybrid/actions

[stars-shield]: https://img.shields.io/github/stars/xybrid-ai/xybrid?style=flat

[stars-url]: https://github.com/xybrid-ai/xybrid/stargazers

[release-shield]: https://img.shields.io/github/v/release/xybrid-ai/xybrid?style=flat&sort=semver

[release-url]: https://github.com/xybrid-ai/xybrid/releases

[release-date-shield]: https://img.shields.io/github/release-date/xybrid-ai/xybrid?style=flat

[pubdev-shield]: https://img.shields.io/pub/v/xybrid_flutter?style=flat&label=pub.dev

[pubdev-url]: https://pub.dev/packages/xybrid_flutter

[maven-shield]: https://img.shields.io/maven-central/v/ai.xybrid/xybrid-kotlin?style=flat&label=Maven%20Central

[maven-url]: https://central.sonatype.com/artifact/ai.xybrid/xybrid-kotlin





      

  



## SDKs

Xybrid is a **Rust-powered runtime** with native bindings for every major platform.

| SDK | Platforms | Install | Status | Sample |

|-----|-----------|---------|--------|--------|

| **[Flutter](bindings/flutter/)** | iOS, Android, macOS, Linux, Windows | [pub.dev](https://pub.dev/packages/xybrid_flutter) | Available | [README](examples/flutter/README.md) |

| **[Unity](bindings/unity/)** | macOS, Windows, Linux | [See below](#install) | Available | [Unity 3D AI tavern](https://github.com/xybrid-ai/xybrid-unity-tavern) |

| **[Swift](bindings/apple/)** | iOS, macOS | Swift Package Manager | Coming Soon | [README](examples/ios/README.md) |

| **[Kotlin](bindings/kotlin/)** | Android | Maven Central | Available | [README](examples/android/README.md) |

| **[CLI](https://github.com/xybrid-ai/xybrid/releases)** | macOS, Linux, Windows | [Download binary](https://github.com/xybrid-ai/xybrid/releases) | Available | — |

| **[Rust](crates/)** | All | `xybrid-core` / `xybrid-sdk` | Available | — |

Every SDK wraps the same Rust core — identical model support and behavior across all platforms.

### Install

**Unity** — Package Manager → Add from git URL:

```bash

https://github.com/xybrid-ai/xybrid.git?path=bindings/unity

```

**Flutter** — add to your `pubspec.yaml`:

```yaml

dependencies:

  xybrid_flutter: ^0.1.0

```

**Kotlin (Android)** — add to your `build.gradle.kts`:

```gradle

dependencies {

    implementation("ai.xybrid:xybrid-kotlin:0.1.0-alpha7")

}

```

---

## Quick Start

See each SDK's README for platform-specific setup: [Flutter](bindings/flutter/) · [Unity](bindings/unity/) · [Swift](bindings/apple/) · [Kotlin](bindings/kotlin/) · [Rust](crates/)

### Single Model

Run a model in one line from the CLI, or three lines from any SDK:

**CLI:**

```sh

xybrid run kokoro-82m --input "Hello world" -o output.wav

```

**Flutter:**

```dart

final model = await Xybrid.model(modelId: 'kokoro-82m').load();

final result = await model.run(envelope: Envelope.text(text: 'Hello world'));

// result → 24kHz WAV audio

```

**Kotlin:**

```kotlin

val model = Xybrid.model(modelId = "kokoro-82m").load()

val result = model.run(envelope = XybridEnvelope.Text("Hello world"))

// result → 24kHz WAV audio

```

**Swift:**

```swift

let model = try Xybrid.model(modelId: "kokoro-82m").load()

let result = try model.run(envelope: .text("Hello world"))

// result → 24kHz WAV audio

```

**Unity (C#):**

```csharp

var model = Xybrid.Model(modelId: "kokoro-82m").Load();

var result = model.Run(envelope: Envelope.Text("Hello world"));

// result → 24kHz WAV audio

```

**Rust:**

```rust

let model = Xybrid::model("kokoro-82m").load()?;

let result = model.run(&Envelope::text("Hello world"))?;

// result → 24kHz WAV audio

```

### Pipelines

Chain models together — build a voice assistant in 3 lines of YAML:

```yaml

# voice-assistant.yaml

name: voice-assistant

stages:

  - model: whisper-tiny    # Speech → text

  - model: qwen2.5-0.5b    # Process with LLM

  - model: kokoro-82m      # Text → speech

```

**CLI:**

```sh

xybrid run voice-assistant.yaml --input question.wav -o response.wav

```

**Flutter:**

```dart

final pipeline = await Xybrid.pipeline(yamlContent: yamlString).load();

await pipeline.loadModels();

final result = await pipeline.run(envelope: Envelope.audio(bytes: audioBytes));

```

**Kotlin:**

```kotlin

val pipeline = Xybrid.pipeline(yamlContent = yamlString).load()

pipeline.loadModels()

val result = pipeline.run(envelope = XybridEnvelope.Audio(bytes = audioBytes))

```

**Swift:**

```swift

let pipeline = try Xybrid.pipeline(yamlContent: yamlString).load()

try pipeline.loadModels()

let result = try pipeline.run(envelope: .audio(bytes: audioBytes))

```

**Unity (C#):**

```csharp

var pipeline = Xybrid.Pipeline(yamlContent: yamlString).Load();

pipeline.LoadModels();

var result = pipeline.Run(envelope: Envelope.Audio(bytes: audioBytes));

```

**Rust:**

```rust

let pipeline = Xybrid::pipeline(&yaml_string).load()?;

pipeline.load_models()?;

let result = pipeline.run(&Envelope::audio(audio_bytes))?;

```

---

## Supported Models

All models run entirely on-device. No cloud, no API keys required. Browse the full registry with `xybrid models list`.

### Speech-to-Text

| Model | Params | Format | Description |

|-------|--------|--------|-------------|

| Whisper Tiny | 39M | SafeTensors | Multilingual transcription (Candle runtime) |

| Wav2Vec2 Base | 95M | ONNX | English ASR with CTC decoding |

### Text-to-Speech

| Model | Params | Format | Description |

|-------|--------|--------|-------------|

| Kokoro 82M | 82M | ONNX | High-quality, 24 natural voices |

| KittenTTS Nano | 15M | ONNX | Ultra-lightweight, 8 voices |

### Language Models

| Model | Params | Format | Description |

|-------|--------|--------|-------------|

| Gemma 3 1B | 1B | GGUF Q4_K_M | Google's mobile-optimized LLM |

| Llama 3.2 1B | 1B | GGUF Q4_K_M | Meta's general purpose, 128K context |

| Qwen 2.5 0.5B | 500M | GGUF Q4_K_M | Compact on-device chat |

| SmolLM2 360M | 360M | GGUF Q4_K_M | Best tiny LLM, excellent quality/size ratio |

### Coming Soon

| Model | Type | Params | Priority | Status |

|-------|------|--------|----------|--------|

| Phi-4 Mini | LLM | 3.8B | P2 | Spec Ready (first multi-quant: Q4, Q8, FP16) |

| Qwen3 0.6B | LLM | 600M | P2 | Planned |

| Trinity Nano | LLM (MoE) | 6B (1B active) | P2 | Planned |

| LFM2 700M | LLM | 700M | P2 | Planned |

| Nomic Embed Text v1.5 | Embeddings | 137M | P1 | Blocked (needs Tokenize/MeanPool steps) |

| LFM2-VL 450M | Vision | 450M | P2 | Planned |

| Whisper Tiny CoreML | ASR | 39M | P2 | Planned |

| Qwen3-TTS 0.6B | TTS | 600M | P2 | Blocked (needs custom SafeTensors runtime) |

| Chatterbox Turbo | TTS | 350M | P3 | Blocked (needs ModelGraph template) |

---

## Features

| Capability | iOS | Android | macOS | Linux | Windows |

|------------|-----|---------|-------|-------|---------|

| Speech-to-Text | ✅ | ✅ | ✅ | ✅ | ✅ |

| Text-to-Speech | ✅ | ✅ | ✅ | ✅ | ✅ |

| Language Models | ✅ | ✅ | ✅ | ✅ | ✅ |

| Vision Models | ✅ | ✅ | ✅ | ✅ | ✅ |

| Embeddings | ✅ | ✅ | ✅ | ✅ | ✅ |

| Pipeline Orchestration | ✅ | ✅ | ✅ | ✅ | ✅ |

| Model Download & Caching | ✅ | ✅ | ✅ | ✅ | ✅ |

| Hardware Acceleration | Metal, ANE | CPU | Metal, ANE | CUDA | CUDA |

---

## Why Xybrid?

- **Privacy first** — All inference runs on-device. Your data never leaves the device.

- **Offline capable** — No internet required after initial model download.

- **Cross-platform** — One API across iOS, Android, macOS, Linux, and Windows.

- **Pipeline orchestration** — Chain models together (ASR → LLM → TTS) in a single call.

- **Automatic optimization** — Hardware acceleration on Apple Neural Engine, Metal, and CUDA.

---

## Community

- [Documentation](https://docs.xybrid.dev)

- [Discord](https://discord.gg/YhFHHkhbad)

- [GitHub Issues](https://github.com/xybrid-ai/xybrid/issues)

## Contributing

We welcome contributions! See [CONTRIBUTING.md](./CONTRIBUTING.md) for guidelines on setting up your development environment, submitting pull requests, and adding new models.

## Star History

[![Star History Chart](https://api.star-history.com/svg?repos=xybrid-ai/xybrid&type=date&legend=bottom-right)](https://www.star-history.com/#xybrid-ai/xybrid&type=date&legend=bottom-right)

## License

Apache License 2.0 — see [LICENSE](./LICENSE) for details.

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Awesome

https://github.com/xybrid-ai/xybrid

Awesome Lists containing this project

README

Xybrid