Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/OpenGVLab/DragGAN

Unofficial Implementation of DragGAN - "Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold" （DragGAN 全功能实现，在线Demo，本地部署试用，代码、模型已全部开源，支持Windows, macOS, Linux）
https://github.com/OpenGVLab/DragGAN

draggan gradio-interface image-editing image-generation interngpt

Last synced: about 2 months ago
JSON representation

Unofficial Implementation of DragGAN - "Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold" （DragGAN 全功能实现，在线Demo，本地部署试用，代码、模型已全部开源，支持Windows, macOS, Linux）

Awesome Lists containing this project

README 

        
# DragGAN

[![PyPI](https://img.shields.io/pypi/v/draggan)](https://pypi.org/project/draggan/) 

[![support](https://img.shields.io/badge/Support-macOS%20%7C%20Windows%20%7C%20Linux-blue)](#running-locally)



:boom:  [`Colab Demo`](https://colab.research.google.com/github/Zeqiang-Lai/DragGAN/blob/master/colab.ipynb)  [`Awesome-DragGAN`](https://github.com/OpenGVLab/Awesome-DragGAN) [`InternGPT Demo`](https://github.com/OpenGVLab/InternGPT)  [`Local Deployment`](#running-locally)  



> **Note for Colab, remember to select a GPU via `Runtime/Change runtime type` (`代码执行程序/更改运行时类型`).**

> 

> If you want to upload custom image, please install 1.1.0 via `pip install draggan==1.1.0`.



Unofficial implementation of [Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold](https://vcai.mpi-inf.mpg.de/projects/DragGAN/)





  

   

  

  




## How it Work ?



Here is a simple tutorial video showing how to use our implementation.



https://github.com/Zeqiang-Lai/DragGAN/assets/26198430/f1516101-5667-4f73-9330-57fc45754283



Check out the original [paper](https://vcai.mpi-inf.mpg.de/projects/DragGAN/) for the backend algorithm and math.



![demo](assets/paper.png)



## News



:star2: **What's New**



- [2023/6/25] Relase version 1.1.1, it includes a major bug fix and speed improvement.

- [2023/6/25] [Official Code](https://github.com/XingangPan/DragGAN) is released, check it out.

- [2023/5/29] A new version is in beta, install via `pip install draggan==1.1.0b2`, includes speed improvement and more models.

- [2023/5/25] DragGAN is on PyPI, simple install via `pip install draggan`. Also addressed the common CUDA problems https://github.com/Zeqiang-Lai/DragGAN/issues/38  https://github.com/Zeqiang-Lai/DragGAN/issues/12

- [2023/5/25] We now support StyleGAN2-ada with much higher quality and more types of images. Try it by selecting models started with "ada".

- [2023/5/24] An out-of-box online demo is integrated in [InternGPT](https://github.com/OpenGVLab/InternGPT) - a super cool pointing-language-driven visual interactive system. Enjoy for free.:lollipop:

- [2023/5/24] Custom Image with GAN inversion is supported, but it is possible that your custom images are distorted  due to the limitation of GAN inversion. Besides, it is also possible the manipulations fail due to the limitation of our implementation.



:star2: **Changelog**



- [x] Add a docker image, thanks [@egbaydarov](https://github.com/egbaydarov).

- [ ] PTI GAN inversion https://github.com/Zeqiang-Lai/DragGAN/issues/71#issuecomment-1573461314

- [x] Tweak performance, See [v2](https://github.com/Zeqiang-Lai/DragGAN/tree/v2).

- [x] Improving installation experience, DragGAN is now on [PyPI](https://pypi.org/project/draggan).

- [x] Automatically determining the number of iterations, See [v2](https://github.com/Zeqiang-Lai/DragGAN/tree/v2).

- [ ] Allow to save video without point annotations, custom image size.

- [x] Support StyleGAN2-ada.

- [x] Integrate into [InternGPT](https://github.com/OpenGVLab/InternGPT)

- [x] Custom Image with GAN inversion.

- [x] Download generated image and generation trajectory.

- [x] Controlling generation process with GUI.

- [x] Automatically download stylegan2 checkpoint.

- [x] Support movable region, multiple handle points.

- [x] Gradio and Colab Demo.



> This project is now a sub-project of [InternGPT](https://github.com/OpenGVLab/InternGPT) for interactive image editing. Future updates of more cool tools beyond DragGAN would be added in [InternGPT](https://github.com/OpenGVLab/InternGPT). 



## Running Locally



Please refer to [INSTALL.md](INSTALL.md).



## Citation



```bibtex

@inproceedings{pan2023draggan,

    title={Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold}, 

    author={Pan, Xingang and Tewari, Ayush, and Leimk{\"u}hler, Thomas and Liu, Lingjie and Meka, Abhimitra and Theobalt, Christian},

    booktitle = {ACM SIGGRAPH 2023 Conference Proceedings},

    year={2023}

}

```



## Acknowledgement



[Official DragGAN](https://github.com/XingangPan/DragGAN)   [DragGAN-Streamlit](https://github.com/skimai/DragGAN)   [StyleGAN2](https://github.com/NVlabs/stylegan2)    [StyleGAN2-pytorch](https://github.com/rosinality/stylegan2-pytorch)    [StyleGAN2-Ada](https://github.com/NVlabs/stylegan2-ada-pytorch)      [StyleGAN-Human](https://github.com/stylegan-human/StyleGAN-Human)    [Self-Distilled-StyleGAN](https://github.com/self-distilled-stylegan/self-distilled-internet-photos)



 Welcome to discuss with us and continuously improve the user experience of DragGAN.

Reach us with this WeChat QR Code. 



imageimage