https://github.com/maekawatoshiki/altius

Small ONNX inference runtime written in Rust
https://github.com/maekawatoshiki/altius

deep-neural-networks onnx rust wasm

Last synced: 3 days ago
JSON representation

Small ONNX inference runtime written in Rust

• Host: GitHub
• URL: https://github.com/maekawatoshiki/altius
• Owner: maekawatoshiki
• License: mit
• Created: 2021-09-10T04:31:36.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2024-10-08T02:23:24.000Z (3 months ago)
• Last Synced: 2024-10-19T10:42:19.641Z (2 months ago)
• Topics: deep-neural-networks, onnx, rust, wasm
• Language: Rust
• Homepage:
• Size: 4.19 MB
• Stars: 92
• Watchers: 5
• Forks: 6
• Open Issues: 11
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-yolo-object-detection - altius
• awesome-yolo-object-detection - altius
• awesome-rust-list - altius
• awesome-rust-list - altius

README

        


    
Altius

    

        

    

    

        

    

    


    Small ONNX inference runtime written in Rust.

    


    Feel free to create

    

        issues

    

    and 

    

        discussions!

    



# Requirements

- cargo

- uv

# Run

```sh

# Download models.

(cd models && ./download.sh)

# Download minimum models.

# (cd models && ./download.sh CI)

# Run examples.

# {mnist, mobilenet, deit, vit} are available.

# You can specify the number of threads for computation by editing the code.

cargo run --release --example mnist

cargo run --release --example mobilenet

cargo run --release --example deit

cargo run --release --example vit

# Experimental CPU backend (that generates code in C)

cargo run --release --example mnist_cpu     -- --iters 10 

cargo run --release --example mobilenet_cpu -- --iters 10 --profile

cargo run --release --example deit_cpu      -- --iters 10 --threads 8 --profile

```

# Run from WebAssembly

Currently, mobilenet v3 runs on web browsers.

```sh

cd wasm

cargo install wasm-pack

wasm-pack build --target web

yarn

yarn serve

```

# Run from Python

```sh

cd ./crates/altius_py

uv sync

uv run maturin develop -r

uv run python mobilenet.py

```