https://github.com/lukas-blecher/cleanplateblender
VFX Blender Add-on for removing objects from a video using Deep Learning
https://github.com/lukas-blecher/cleanplateblender
blender blender-addon deep-learning inpainting vfx video-inpainting
Last synced: about 1 month ago
JSON representation
VFX Blender Add-on for removing objects from a video using Deep Learning
- Host: GitHub
- URL: https://github.com/lukas-blecher/cleanplateblender
- Owner: lukas-blecher
- Created: 2020-01-14T23:59:43.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2020-09-01T16:39:59.000Z (about 5 years ago)
- Last Synced: 2025-05-06T23:31:28.882Z (5 months ago)
- Topics: blender, blender-addon, deep-learning, inpainting, vfx, video-inpainting
- Language: Python
- Homepage:
- Size: 118 KB
- Stars: 17
- Watchers: 3
- Forks: 3
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# CleanPlateBlender
This Add-on for Blender 2.8x is utilizing Deep Learning methods to remove objects from videos. The technique to do this is based mainly on the following repository: https://github.com/nbei/Deep-Flow-Guided-Video-Inpainting. I've modified it so it can be used more easily. The changes are available in my [fork](https://github.com/lukas-blecher/Deep-Flow-Guided-Video-Inpainting).
If you don't have a Nvidia GPU in your system or your if are willing to sacrifice quality for faster computation check out the [onion branch](https://github.com/lukas-blecher/CleanPlateBlender/tree/onion) of this repository where I integrated another method for video inpainting into Blender.
## Usage
Create a mask for the object you want to remove in the `Clip Editor`. This Add-on is compatible with my [AutoMask](https://github.com/lukas-blecher/AutoMask) Blender Add-on that uses Deep Learning to track a mask in a video.
* Mask: Select the mask you want to remove
* Downscale: A downscaling factor from the original video size. Usefull if you run out of CUDA memory.
* Enlarge Mask: If your mask is not covering the object completley this parameter enlarges the mask during computation.
* File Format: The image format of the output images.
* Output Directory: Where to save the output images.
* Threshold: If you are not satisfied with the results try varying this parameter.
## Installation
The Add-on is heavily dependent on python libraries. You can either install the dependencies to the Blender python or if python is already installed on the system and the python version is compatible with the Blender python version you can also install the dependencies on your system. In the latter case you need to replace `#r'PYTHON_PATH'` with the path to your python site packages in the `__init__.py` file.
1. Download the repository as `.zip` file
2. Add the `zip` file as Add-on in Blender (**Do not yet activate it since the dependencies are missing**)
3. Go to the Blender Add-on directory and install the python packages
```
pip install -r requirements.txt
```
4. Download the pretrained models and save them into `weights`. Follow these [instructions](https://github.com/lukas-blecher/CleanPlateBlender/blob/master/weights/README.md).
5. Now you can activate the Add-on in Blender
## FAQ
Q: The CuPy installation failed
A: Try installing a binary package (e.g. `pip install cupy-cuda100`).
## License
The software is for educaitonal and academic research purpose only [[1](https://github.com/JiahuiYu/generative_inpainting#license), [2](https://github.com/twhui/LiteFlowNet/blob/master/LICENSE)].
## Acknowledgements
[Deep-Flow-Guided-Video-Inpainting](https://github.com/nbei/Deep-Flow-Guided-Video-Inpainting), [LiteFlowNet original](https://github.com/twhui/LiteFlowNet), [LiteFlowNet pytorch](https://github.com/sniklaus/pytorch-liteflownet), [DeepFill](https://github.com/JiahuiYu/generative_inpainting)