Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/pykeio/ort

Fast ML inference & training for ONNX models in Rust
https://github.com/pykeio/ort

ai ai-training fine-tuning inference machine-learning onnx onnxruntime rust

Last synced: 2 days ago
JSON representation

Fast ML inference & training for ONNX models in Rust

Host: GitHub
URL: https://github.com/pykeio/ort
Owner: pykeio
License: apache-2.0
Created: 2022-11-26T19:26:15.000Z (about 2 years ago)
Default Branch: main
Last Pushed: 2025-01-19T17:42:30.000Z (11 days ago)
Last Synced: 2025-01-20T00:00:12.045Z (11 days ago)
Topics: ai, ai-training, fine-tuning, inference, machine-learning, onnx, onnxruntime, rust
Language: Rust
Homepage: https://ort.pyke.io/
Size: 4.08 MB
Stars: 1,064
Watchers: 8
Forks: 105
Open Issues: 0
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE-APACHE

Awesome Lists containing this project

awesome-oneapi - ort - ort is an (unofficial) ONNX Runtime 1.15 wrapper for Rust based on the now inactive onnxruntime-rs. ONNX Runtime accelerates ML inference on both CPU & GPU. (Table of Contents / AI - Machine Learning)
awesome-yolo-object-detection - ort
awesome-rust-list - ort
awesome-rust-list - ort

README

        


    

    

      

    


     



`ort` is an (unofficial) [ONNX Runtime](https://onnxruntime.ai/) 1.20 wrapper for Rust based on the now inactive [`onnxruntime-rs`](https://github.com/nbigaouette/onnxruntime-rs). ONNX Runtime accelerates ML inference and training on both CPU & GPU.

## 📖 Documentation

- [Guide](https://ort.pyke.io/)

- [API reference](https://docs.rs/ort/2.0.0-rc.9/ort/)

- [Examples](https://github.com/pykeio/ort/tree/main/examples)

- [Migrating from v1.x to v2.0](https://ort.pyke.io/migrating/v2)

## 🤔 Support

- [Discord: `#💬｜ort-discussions`](https://discord.gg/uQtsNu2xMa)

- [GitHub Discussions](https://github.com/pykeio/ort/discussions)

- [Email](mailto:[email protected])

## 💖 Projects using `ort`

_{[Open a PR](https://github.com/pykeio/ort/pulls) to add your project here 🌟}

- **[Bloop](https://bloop.ai/)** uses `ort` to power their semantic code search feature.

- **[edge-transformers](https://github.com/npc-engine/edge-transformers)** uses `ort` for accelerated transformer model inference at the edge.

- **[Ortex](https://github.com/relaypro-open/ortex)** uses `ort` for safe ONNX Runtime bindings in Elixir.

- **[Supabase](https://supabase.com/)** uses `ort` to remove cold starts for their edge functions.

- **[Lantern](https://github.com/lanterndata/lantern_extras)** uses `ort` to provide embedding model inference inside Postgres.

- **[Magika](https://github.com/google/magika)** uses `ort` for content type detection.

- **[`sbv2-api`](https://github.com/tuna2134/sbv2-api)** is a fast implementation of Style-BERT-VITS2 text-to-speech using `ort`.

- **[Ahnlich](https://github.com/deven96/ahnlich)** uses `ort` to power their AI proxy for semantic search applications.

- **[Spacedrive](https://github.com/spacedriveapp/spacedrive)** is a cross-platform file manager with AI features powered by `ort`.

- **[BoquilaHUB](https://github.com/boquila/boquilahub/)** uses `ort` for local AI deployment in biodiversity conservation efforts.

## 🌠 Sponsor `ort`