https://github.com/taki0112/munit-tensorflow

Simple Tensorflow implementation of "Multimodal Unsupervised Image-to-Image Translation" (ECCV 2018)
https://github.com/taki0112/munit-tensorflow

image-translation munit tensorflow

Last synced: 3 months ago
JSON representation

Simple Tensorflow implementation of "Multimodal Unsupervised Image-to-Image Translation" (ECCV 2018)

• Host: GitHub
• URL: https://github.com/taki0112/munit-tensorflow
• Owner: taki0112
• License: mit
• Created: 2018-04-16T14:40:47.000Z (about 7 years ago)
• Default Branch: master
• Last Pushed: 2019-08-13T02:56:23.000Z (almost 6 years ago)
• Last Synced: 2025-04-02T11:56:01.434Z (3 months ago)
• Topics: image-translation, munit, tensorflow
• Language: Python
• Homepage:
• Size: 3.06 MB
• Stars: 301
• Watchers: 13
• Forks: 88
• Open Issues: 8
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# MUNIT-Tensorflow

Simple Tensorflow implementation of ["Multimodal Unsupervised Image-to-Image Translation"](https://arxiv.org/abs/1804.04732)

## Requirements

* Tensorflow 1.4

* Python 3.6

## Issue

* Author uses so many iterations (1M = 1,000,000)

* Author uses LSGAN, but do not multiply each of G and D by 0.5

## Usage

```

├── dataset

   └── YOUR_DATASET_NAME

       ├── trainA

           ├── xxx.jpg (name, format doesn't matter)

           ├── yyy.png

           └── ...

       ├── trainB

           ├── zzz.jpg

           ├── www.png

           └── ...

       ├── testA

           ├── aaa.jpg 

           ├── bbb.png

           └── ...

       └── testB

           ├── ccc.jpg 

           ├── ddd.png

           └── ...

           

├── guide.jpg (example for guided image translation task)

```

### Train

* python main.py --phase train --dataset summer2winter --batch_size 1

### Test

* python main.py --phase test --dataset summer2winter --batch_size 1 --num_style 3

### Guided Image Translation

* python main.py --phase guide --dataset summer2winter --batch_size 1 --direction a2b --guide_img guide.jpg

## Summary

![illustration](./assests/method_illustration.png)

## Architecture 

![architecture](./assests/architecture.png)

## Model Overview

![model_overview](./assests/model_overview.png)

## Results

### Edges to Shoes/handbags Translation

![edges2shoes_handbags](./assests/edges2shoes_handbags.jpg)

### Animal Image Translation

![animal](./assests/animal.jpg)

### Street Scene Translation

![street](./assests/street.jpg)

### Yosemite Summer to Winter Translation (HD)

![summer2winter_yosemite](./assests/summer2winter_yosemite.jpg)

### Example-guided Image Translation

![guide](./assests/guide.jpg)

## Related works

* [CycleGAN-Tensorflow](https://github.com/taki0112/CycleGAN-Tensorflow)

* [DiscoGAN-Tensorflow](https://github.com/taki0112/DiscoGAN-Tensorflow)

* [UNIT-Tensorflow](https://github.com/taki0112/UNIT-Tensorflow)

* [StarGAN-Tensorflow](https://github.com/taki0112/StarGAN-Tensorflow)

* [DRIT-Tensorflow](https://github.com/taki0112/DRIT-Tensorflow)

## Reference

* [MUNIT-Pytorch](https://github.com/NVlabs/MUNIT) (Author implementation)

## Author

Junho Kim