Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/iPERDance/iPERCore
Liquid Warping GAN with Attention: A Unified Framework for Human Image Synthesis
https://github.com/iPERDance/iPERCore
Last synced: about 2 months ago
JSON representation
Liquid Warping GAN with Attention: A Unified Framework for Human Image Synthesis
- Host: GitHub
- URL: https://github.com/iPERDance/iPERCore
- Owner: iPERDance
- License: apache-2.0
- Created: 2020-11-17T15:36:25.000Z (about 4 years ago)
- Default Branch: main
- Last Pushed: 2023-05-12T03:23:38.000Z (over 1 year ago)
- Last Synced: 2024-10-29T17:50:48.368Z (about 2 months ago)
- Language: Python
- Homepage: https://iperdance.github.io/work/impersonator-plus-plus.html
- Size: 22.5 MB
- Stars: 2,414
- Watchers: 52
- Forks: 311
- Open Issues: 72
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- StarryDivineSky - iPERDance/iPERCore
README
# Impersonator++
### Update News
- [x] 15/04/2021, iPERCore-0.2.0, including
* Add [Training](./docs/train_details.md)
* Add [Novel View Synthesis](https://github.com/iPERDance/iPERCore/blob/main/docs/scripts_runner.md#run-novel-view-synthesis)
* Add [Motion Imitation with bullet-time effects](https://github.com/iPERDance/iPERCore/blob/main/docs/scripts_runner.md#run-motion-imitation-with-bullet-time-effect)
* Add [Motion Imitation with multi-view outputs](https://github.com/iPERDance/iPERCore/blob/main/docs/scripts_runner.md#run-motion-imitation-with-multi-view-outputs)
* Add [Appearance Transfer](https://github.com/iPERDance/iPERCore/blob/main/docs/scripts_runner.md#run-human-appearance-transfer)
* Add [A Unified synthesizer: Motion Imitation + Appearance Transfer + Novel View Synthesis](https://github.com/iPERDance/iPERCore/blob/main/docs/scripts_runner.md#human-appearance-transfer-with-motion-imitation-and-novel-view-synthesis)
* Update torch 1.8+ with RTX30+ GPUs.
[comment]: <> (- [x] 12/20/2020, A precompiled version on Windows has been released! [[Usage]](https://github.com/iPERDance/iPERCore/wiki/How-to-use-the-released-version-on-windows%3F))
- [x] 12/10/2020, iPERCore-0.1.1, supports Windows.
- [x] 12/06/2020, iPERCore-0.1, all the base codes. The motion imitation scripts.
See the details of developing [logs](./docs/dev_logs.md).
**Liquid Warping GAN with Attention: A Unified Framework for Human Image Synthesis**, including
human motion imitation, appearance transfer, and novel view synthesis. Currently the paper is under review of
IEEE TPAMI. It is an extension of our previous ICCV project [impersonator](https://github.com/svip-lab/impersonator),
and it has a more powerful ability in generalization and produces higher-resolution results (512 x 512, 1024 x 1024) than the previous ICCV version.
| 🧾 Colab Notebook | 📑 Paper | 📱 Website | 📂 Dataset | 💡 Bilibili |
:-: | :-: | :-: | :-: | :-: |
| [](https://colab.research.google.com/drive/1bwUnj-9NnJA2EMr7eWO4I45UuBtKudg_?usp=sharing) | [paper](https://arxiv.org/pdf/2011.09055.pdf) | [website](https://iperdance.github.io/work/impersonator-plus-plus.html) | [Dataset](https://svip-lab.github.io/dataset/iPER_dataset.html) | [bilibili](https://space.bilibili.com/1018066133) |
## Installation
See more details, including system dependencies, python requirements and setups in [install.md](./docs/install.md).
Please follows the instructions in [install.md](./docs/install.md) to install this firstly.
**Notice that `imags_size=512` need at least 9.8GB GPU memory.** if you are using a middle-level GPU(e.g. RTX 2060), you should change the `image_size` to 384 or 256. The following table can be used as a reference:
| image_size | preprocess | personalize | run_imitator | recommended gpu |
| ---------- | ---------- | ----------- | ------------ | ---------------------------------- |
| 256x256 | 3.1 GB | 4.3 GB | 1.1 GB | RTX 2060 / RTX 2070 |
| 384x384 | 3.1 GB | 7.9 GB | 1.5 GB | GTX 1080Ti / RTX 2080Ti / Titan Xp |
| 512x512 | 3.1 GB | 9.8 GB | 2 GB | GTX 1080Ti / RTX 2080Ti / Titan Xp |
| 1024x1024 | 3.1 GB | 20 GB | - | RTX Titan / P40 / V100 32G |
## Run demos
### 1. Run on Google Colab
[](https://colab.research.google.com/drive/1bwUnj-9NnJA2EMr7eWO4I45UuBtKudg_?usp=sharing)
### 2. Run with Console (scripts) mode
See [scripts_runner](./docs/scripts_runner.md) for more details.
## Citation
```
@article{liu2021liquid,
title={Liquid warping GAN with attention: A unified framework for human image synthesis},
author={Liu, Wen and Piao, Zhixin and Tu, Zhi and Luo, Wenhan and Ma, Lin and Gao, Shenghua},
journal={IEEE Transactions on Pattern Analysis and Machine Intelligence},
year={2021},
publisher={IEEE}
}
@InProceedings{lwb2019,
title={Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesis},
author={Wen Liu and Zhixin Piao, Min Jie, Wenhan Luo, Lin Ma and Shenghua Gao},
booktitle={The IEEE International Conference on Computer Vision (ICCV)},
year={2019}
}
```