https://github.com/maekawatoshiki/altius

Small ONNX inference runtime written in Rust
https://github.com/maekawatoshiki/altius

deep-neural-networks onnx rust wasm

Last synced: 12 days ago
JSON representation

Small ONNX inference runtime written in Rust

• Host: GitHub
• URL: https://github.com/maekawatoshiki/altius
• Owner: maekawatoshiki
• License: mit
• Created: 2021-09-10T04:31:36.000Z (almost 3 years ago)
• Default Branch: main
• Last Pushed: 2024-05-31T17:23:57.000Z (27 days ago)
• Last Synced: 2024-06-01T12:42:14.470Z (26 days ago)
• Topics: deep-neural-networks, onnx, rust, wasm
• Language: Rust
• Homepage:
• Size: 3.91 MB
• Stars: 87
• Watchers: 5
• Forks: 5
• Open Issues: 6
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Lists

• awesome-yolo-object-detection - altius

README

        


    
Altius

    

        

    

    

        

    

    


    Small ONNX inference runtime written in Rust.

    


    Feel free to create

    

        issues

    

    and 

    

        discussions!

    



# Requirements

- cargo

- rye

# Run

```sh

# Download models.

(cd models && ./download.sh)

# Download minimum models.

# (cd models && ./download.sh CI)

# Run examples.

# {mnist, mobilenet, deit, vit} are available.

# You can specify the number of threads for computation by editing the code.

cargo run --release --example mnist

cargo run --release --example mobilenet

cargo run --release --example deit

cargo run --release --example vit

# Experimental CPU backend (that generates code in C)

cargo run --release --example mnist_cpu     -- --iters 10 

cargo run --release --example mobilenet_cpu -- --iters 10 --profile

cargo run --release --example deit_cpu      -- --iters 10 --threads 8 --profile

```

# Run from WebAssembly

Currently, mobilenet v3 runs on web browsers.

```sh

cd wasm

cargo install wasm-pack

wasm-pack build --target web

yarn

yarn serve

```

# Run from Python

```sh

cd ./crates/altius-py

rye sync --features linux # no --features needed on macOS

rye run maturin develop -r

rye run python mobilenet.py

```