Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/woctezuma/steam-lightweight-gan

Train a "lightweight GAN" on Colaboratory to generate Steam banners.
https://github.com/woctezuma/steam-lightweight-gan

colab colab-notebook colaboratory gan generative-adversarial-network google-colab google-colab-notebook google-colaboratory lightweight lightweight-gan steam steam-api steam-data steam-game steam-games steam-gan steam-pics steam-store

Last synced: 23 days ago
JSON representation

Train a "lightweight GAN" on Colaboratory to generate Steam banners.

Awesome Lists containing this project

README 

        
# Steam Lightweight-GAN



![Examples of generated Steam banners][cover-illustration]



The goal of this [Colab][colab-website] notebook is to capture the distribution of Steam banners and sample with a "lightweight GAN".



## Usage



-   Acquire a dataset, e.g. one of the versions proposed with [`Steam-OneFace`][steam-oneface-section],

-   Run [`Steam_Lightweight_GAN.ipynb`][Lightweight_GAN_training] to train a "lightweight GAN" from scratch,

[![Open In Colab][colab-badge]][Lightweight_GAN_training]



## Data



The dataset consists of `Steam-OneFace-small`, which is a small version of [`Steam-OneFace`][steam-oneface-section].

It features 993 Steam banners, with RGB channels and resized from 300x450 to 256x256 resolution.

The banners were selected to contain exactly one face, based on the two face detection modules `face_alignment` and `retinaface`.



## Training parameters



Following the remark for datasets with ~ 2k images in the paper for [StyleGAN2-ADA][stylegan2-ada-paper]:

-   I have settled for a fixed augmentation probability equal to 0.4,

-   the augmentation was initially constrained to `translation`.



After 27k iterations, the discriminator (D) loss was much lower than the generator (G) loss, and close to zero, so the `color` augmentation was added.

Caveat: in the StyleGAN2-ADA paper, it is mentioned that "color" was only slightly beneficial.



After 54k iterations, for the same reason, the `cutout` augmentation was added.

Caveat: in the StyleGAN2-ADA paper, it is mentioned that "cutout" was detrimental to the results.



![Augmentation: types][augmentation_types]



![Augmentation: strength][augmentation_strength]



![Augmentation: illustration][augmentation_illustration]



With Tesla T4 (with 16 GB VRAM), the mini-batch size could be set to 64 images.

Because the mini-batch size is greater than 32, gradient accumulation is not needed.



[Automatic Mixed Precision][nvidia-amp-doc] is toggled ON.



## Results



### Training time



Depending on the GPU provided by Google Colab, the total training may vary wildly.



With Tesla T4, an iteration requires 1.6 second.

For 150k iterations, the total training time is expected to be slightly less than 70 hours.



With Tesla K80, an iteration will require much longer time.

Moreover, you would have to decrease the mini-batch size to 32, and maybe rely on gradient accumulation.



### Model checkpoints



During training, checkpoints of the model are saved every thousand epochs, and shared on [Google Drive][gdrive-lightweight-gan-checkpoints].



### Generated Steam banners



TODO



## References



-   DCGAN:

    -   [Radford, Alec, et al. *Unsupervised Representation learning with Deep Convolutional GAN*. ICLR 2016.][dcgan-paper]

    -   [Official implementation][dcgan-official-repository]

    -   [Application to Steam banners][dcgan-applied-to-steam-banners]

-   StyleGAN:

    -   [Karras, Tero, et al. *A Style-Based Generator Architecture for Generative Adversarial Networks*. CVPR 2019.][stylegan1-paper]

    -   [Official implementation][stylegan1-official-repository]

    -   [Application to Steam banners][stylegan1-applied-to-steam-banners]

-   StyleGAN2:

    - [Karras, Tero, et al. *Analyzing and Improving the Image Quality of StyleGAN*. CVPR 2020.][stylegan2-paper]

    -   [Official implementation][stylegan2-official-repository]

    -   [Application to Steam banners][stylegan2-applied-to-steam-banners]

-   StyleGAN2-ADA:

    -   [Karras, Tero, et al. *Training generative adversarial networks with limited data*. NeurIPS 2020.][stylegan2-ada-paper]

    -   [Official implementation][stylegan2-ada-official-repository]

    -   [Application to Steam banners][stylegan2-ada-applied-to-steam-banners]

-   "Lightweight-GAN":

    -   [N/A. *Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesis*. ICLR 2021.][lightweight-gan-paper]

    -   [Unofficial implementation][lightweight-gan-unofficial-repository]

    -   [Application to Steam banners][lightweight-gan-applied-to-steam-banners]    

    



[cover-illustration]: 



[augmentation_illustration]: 

[augmentation_strength]: 

[augmentation_types]: 



[steam-oneface-section]: 



[colab-website]: 

[colab-badge]: 

[Lightweight_GAN_training]: 



[gdrive-lightweight-gan-checkpoints]: 



[dcgan-paper]: 

[stylegan1-paper]: 

[stylegan2-paper]: 

[stylegan2-ada-paper]: 

[lightweight-gan-paper]: 



[dcgan-official-repository]: 

[stylegan1-official-repository]: 

[stylegan2-official-repository]: 

[stylegan2-ada-official-repository]: 

[lightweight-gan-unofficial-repository]: 



[dcgan-applied-to-steam-banners]: 

[stylegan1-applied-to-steam-banners]: 

[stylegan2-applied-to-steam-banners]: 

[stylegan2-ada-applied-to-steam-banners]: 

[lightweight-gan-applied-to-steam-banners]: 



[nvidia-amp-doc]: