https://github.com/cd123-cd/ControlEdit

a clothe local editing method
https://github.com/cd123-cd/ControlEdit

Last synced: 4 months ago
JSON representation

a clothe local editing method

• Host: GitHub
• URL: https://github.com/cd123-cd/ControlEdit
• Owner: cd123-cd
• Created: 2024-07-15T14:22:24.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2024-07-15T16:35:44.000Z (6 months ago)
• Last Synced: 2024-07-15T19:34:15.360Z (6 months ago)
• Size: 208 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-diffusion-categorized - [Code

README

        
# ControlEdit: A MultiModal Local Clothing Image Editing Method

  

![Result Image](banner.jpg)

🔥News

- [07/20/2024] Our paper has been accepted by The British Machine Vision Association and Society for Pattern Recognition  (BMVC)!

  

**Abstract:**

Multimodal clothing image editing refers to the precise adjustment and modification of clothing images using data such as textual 

descriptions and visual images as control conditions, which effectively improves the work efficiency of designers and reduces the threshold 

for user design. In this paper, we propose a new image editing method-ControlEdit, which transfers clothing image editing to multimodal-

guided local inpainting of clothing images. We address the difficulty of collecting real image datasets by leveraging the self-supervised learning 

approach. Based on this learning approach, we extend the channels of the feature extraction network to ensure consistent clothing image 

style before and after editing, and we design an inverse latent loss function to achieve soft control over the content of non-edited 

areas. In addition, we use Blended Latent Diffusion as the sampling method to make the editing boundaries transition naturally and enforce

 consistency of non-edited area content. Extensive experiments demonstrate that ControlEdit surpasses baseline algorithms in both 

qualitative and quantitative evaluations.

## Code Release Plan

Currently, the code is not available. The code and related resources will be released at a later date. Stay tuned for updates.

## Citation

```BibTeX

@misc{cheng2024controleditmultimodallocalclothing,

      title={ControlEdit: A MultiModal Local Clothing Image Editing Method}, 

      author={Di Cheng and YingJie Shi and ShiXin Sun and JiaFu Zhang and WeiJing Wang and Yu Liu},

      year={2024},

      eprint={2409.14720},

      archivePrefix={arXiv},

      primaryClass={cs.CV},

      url={https://arxiv.org/abs/2409.14720}, 

}