Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/levihsu/OOTDiffusion
Official implementation of OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on
https://github.com/levihsu/OOTDiffusion
Last synced: about 2 months ago
JSON representation
Official implementation of OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on
- Host: GitHub
- URL: https://github.com/levihsu/OOTDiffusion
- Owner: levihsu
- License: other
- Created: 2024-01-24T07:39:15.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2024-05-13T08:50:07.000Z (7 months ago)
- Last Synced: 2024-06-10T08:49:06.603Z (6 months ago)
- Language: Python
- Homepage:
- Size: 26.6 MB
- Stars: 4,941
- Watchers: 70
- Forks: 711
- Open Issues: 57
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-diffusion-categorized - [Code
- AiTreasureBox - levihsu/OOTDiffusion - 12-20_5886_4](https://img.shields.io/github/stars/levihsu/OOTDiffusion.svg)|Official implementation of OOTDiffusion| (Repos)
- awesome-ai - OOTDiffusion
README
# OOTDiffusion
This repository is the official implementation of OOTDiffusion
🤗 [Try out OOTDiffusion](https://huggingface.co/spaces/levihsu/OOTDiffusion)
(Thanks to [ZeroGPU](https://huggingface.co/zero-gpu-explorers) for providing A100 GPUs)
> **OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on** [[arXiv paper](https://arxiv.org/abs/2403.01779)]
> [Yuhao Xu](http://levihsu.github.io/), [Tao Gu](https://github.com/T-Gu), [Weifeng Chen](https://github.com/ShineChen1024), [Chengcai Chen](https://www.researchgate.net/profile/Chengcai-Chen)
> Xiao-i Research
Our model checkpoints trained on [VITON-HD](https://github.com/shadow2496/VITON-HD) (half-body) and [Dress Code](https://github.com/aimagelab/dress-code) (full-body) have been released
* 🤗 [Hugging Face link](https://huggingface.co/levihsu/OOTDiffusion) for ***checkpoints*** (ootd, humanparsing, and openpose)
* 📢📢 We support ONNX for [humanparsing](https://github.com/GoGoDuck912/Self-Correction-Human-Parsing) now. Most environmental issues should have been addressed : )
* Please also download [clip-vit-large-patch14](https://huggingface.co/openai/clip-vit-large-patch14) into ***checkpoints*** folder
* We've only tested our code and models on Linux (Ubuntu 22.04)
Â
Â
## Installation
1. Clone the repository
```sh
git clone https://github.com/levihsu/OOTDiffusion
```
2. Create a conda environment and install the required packages
```sh
conda create -n ootd python==3.10
conda activate ootd
pip install torch==2.0.1 torchvision==0.15.2 torchaudio==2.0.2
pip install -r requirements.txt
```
## Inference
1. Half-body model
```sh
cd OOTDiffusion/run
python run_ootd.py --model_path --cloth_path --scale 2.0 --sample 4
```
2. Full-body model
> Garment category must be paired: 0 = upperbody; 1 = lowerbody; 2 = dress
```sh
cd OOTDiffusion/run
python run_ootd.py --model_path --cloth_path --model_type dc --category 2 --scale 2.0 --sample 4
```
## Citation
```
@article{xu2024ootdiffusion,
title={OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on},
author={Xu, Yuhao and Gu, Tao and Chen, Weifeng and Chen, Chengcai},
journal={arXiv preprint arXiv:2403.01779},
year={2024}
}
```
## Star History
[](https://star-history.com/#levihsu/OOTDiffusion&Date)
## TODO List
- [x] Paper
- [x] Gradio demo
- [x] Inference code
- [x] Model weights
- [ ] Training code