https://github.com/smunaut/rvmofx

OpenFX plugin for automatic background removal using RobusVideoMatting
https://github.com/smunaut/rvmofx

matting openfx pytorch video

Last synced: 20 days ago
JSON representation

OpenFX plugin for automatic background removal using RobusVideoMatting

• Host: GitHub
• URL: https://github.com/smunaut/rvmofx
• Owner: smunaut
• License: gpl-3.0
• Created: 2022-12-27T22:49:57.000Z (about 2 years ago)
• Default Branch: master
• Last Pushed: 2022-12-30T14:34:16.000Z (about 2 years ago)
• Last Synced: 2024-11-08T06:52:22.669Z (2 months ago)
• Topics: matting, openfx, pytorch, video
• Language: C++
• Homepage:
• Size: 21.5 KB
• Stars: 8
• Watchers: 2
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
OpenFX plugin for "Robust Video Matting"

========================================

This repo contains an OpenFX plugin using the AI models from :

https://peterl1n.github.io/RobustVideoMatting/#/

https://github.com/PeterL1n/RobustVideoMatting

This allows for automatic background removal using a TorchScript model

in any compatible OpenFX host. Currently only tested with Davinci Resolve 18.1

Build

-----

* Make sure to clone this repo using `--recursive` or to init/update

  submodules afterwards since the openFX support libraries are required

  for the build.

* Install the LibTorch binaries from https://pytorch.org/ for your target.

  Make sure to use the non-cxx11 version ! (At least required for use with

  Davinci Resolve).

* Then build using cmake the usual way.

Install

-------

Currently there is no install target and you need to copy files manually.

On linux the layout should end up looking like :

```

/usr/OFX/Plugins/rvmofx.ofx.bundle

/usr/OFX/Plugins/rvmofx.ofx.bundle/Contents

/usr/OFX/Plugins/rvmofx.ofx.bundle/Contents/Linux-x86-64

/usr/OFX/Plugins/rvmofx.ofx.bundle/Contents/Linux-x86-64/rvmofx.ofx

/usr/OFX/Plugins/rvmofx.ofx.bundle/Contents/Resources

/usr/OFX/Plugins/rvmofx.ofx.bundle/Contents/Resources/rvm_mobilenetv3_fp16.torchscript

/usr/OFX/Plugins/rvmofx.ofx.bundle/Contents/Resources/rvm_resnet50_fp16.torchscript

/usr/OFX/Plugins/rvmofx.ofx.bundle/Contents/Resources/rvm_resnet50_fp32.torchscript

/usr/OFX/Plugins/rvmofx.ofx.bundle/Contents/Resources/rvm_mobilenetv3_fp32.torchscript

```

(you need to download and install the pre-trained models from the original repo)