https://github.com/mlverse/torchvisionlib

torchvision C++ library extensions
https://github.com/mlverse/torchvisionlib

Last synced: 12 months ago
JSON representation

torchvision C++ library extensions

• Host: GitHub
• URL: https://github.com/mlverse/torchvisionlib
• Owner: mlverse
• License: other
• Created: 2022-01-10T19:06:29.000Z (over 4 years ago)
• Default Branch: main
• Last Pushed: 2025-04-14T16:39:44.000Z (about 1 year ago)
• Last Synced: 2025-06-22T21:18:07.021Z (about 1 year ago)
• Language: C++
• Size: 304 KB
• Stars: 9
• Watchers: 3
• Forks: 2
• Open Issues: 1
• Metadata Files:
  • Readme: README.Rmd
  • Changelog: NEWS.md
  • License: LICENSE

Awesome Lists containing this project

README

          
---

output: github_document

---

```{r, include = FALSE}

knitr::opts_chunk$set(

  collapse = TRUE,

  comment = "#>",

  fig.path = "man/figures/README-",

  out.width = "100%"

)

```

# torchvisionlib

[![Lifecycle: experimental](https://img.shields.io/badge/lifecycle-experimental-orange.svg)](https://lifecycle.r-lib.org/articles/stages.html)

[![R-CMD-check](https://github.com/mlverse/torchvisionlib/actions/workflows/R-CMD-check.yaml/badge.svg)](https://github.com/mlverse/torchvisionlib/actions/workflows/R-CMD-check.yaml)

[![CRAN status](https://www.r-pkg.org/badges/version/torchvisionlib)](https://CRAN.R-project.org/package=torchvisionlib)

[![](https://cranlogs.r-pkg.org/badges/torchvisionlib)](https://cran.r-project.org/package=torchvisionlib)

[![Discord](https://img.shields.io/discord/837019024499277855?logo=discord)](https://discord.com/invite/s3D5cKhBkx)

The goal of torchvisionlib is to provide access to C++ opeartions implemented in

[torchvision](https://github.com/pytorch/vision). It provides plain R acesss to

some of those C++ operations but, most importantly it provides full support for 

JIT operators defined in [torchvision](https://github.com/pytorch/vision), allowing

us to load 'scripted' object detection and image segmentation models.

## Installation

torchvisionlib can be installed from CRAN with:

```r

install.packages("torchvisionlib")

```

You can also install the development version of torchvisionlib from [GitHub](https://github.com/) with:

``` r

# install.packages("devtools")

devtools::install_github("mlverse/torchvisionlib")

```

## Example

Suppose that we want to load an image detection model implemented in torchvision.

First, in Python, we can save JIT script and then save this model:

```python

import torch

import torchvision

model = torchvision.models.detection.fasterrcnn_mobilenet_v3_large_320_fpn(pretrained=True)

model.eval()

jit_model = torch.jit.script(model)

torch.jit.save(jit_model, "fasterrcnn_mobilenet_v3_large_320_fpn.pt")

```

We can then load this model in R. Simply loading torchvisionlib will register all

JIT operators, and we can use `torch::jit_load()`.

```{r include=FALSE}

url <- "https://storage.googleapis.com/torch-lantern-builds/testing-models/fasterrcnn_mobilenet_v3_large_320_fpn.pt"

download.file(url, destfile = "fasterrcnn_mobilenet_v3_large_320_fpn.pt", mode = "wb")

```

```{r}

library(torchvisionlib)

model <- torch::jit_load("fasterrcnn_mobilenet_v3_large_320_fpn.pt")

model

```

You can then use this model to make preditions or even fine tuning.