https://github.com/junjiehe96/UniPortrait

UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalizations
https://github.com/junjiehe96/UniPortrait

Last synced: about 2 months ago
JSON representation

UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalizations

• Host: GitHub
• URL: https://github.com/junjiehe96/UniPortrait
• Owner: junjiehe96
• License: apache-2.0
• Created: 2024-08-12T07:10:35.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2024-08-13T01:54:08.000Z (6 months ago)
• Last Synced: 2024-08-16T08:05:30.382Z (5 months ago)
• Size: 18.9 MB
• Stars: 93
• Watchers: 10
• Forks: 5
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt

Awesome Lists containing this project

• awesome-diffusion-categorized - [Code

README

        


UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalization












UniPortrait is an innovative human image personalization framework. It customizes single- and multi-ID images in a

unified manner, providing high-fidelity identity preservation, extensive facial editability, free-form text description,

and no requirement for a predetermined layout.

---

## Release

- [2024/10/18] 🔥 We release the inference code and demo, which has simply

  integrated [ControlNet](https://github.com/lllyasviel/ControlNet)

  , [IP-Adapter](https://github.com/tencent-ailab/IP-Adapter),

  and [StyleAligned](https://github.com/google/style-aligned). The weight for this version is consistent with the

  huggingface space and experiments in the paper. We are now working on generalizing our method to more advanced

  diffusion models and more general custom concepts. Please stay tuned!

- [2024/08/12] 🔥 We release the [technical report](https://arxiv.org/abs/2408.05939)

  , [project page](https://aigcdesigngroup.github.io/UniPortrait-Page/),

  and [HuggingFace demo](https://huggingface.co/spaces/Junjie96/UniPortrait) 🤗!

## Quickstart

```shell

# Clone repository

git clone https://github.com/junjiehe96/UniPortrait.git

# install requirements

cd UniPortrait

pip install -r requirements.txt

# download the models

git lfs install

git clone https://huggingface.co/Junjie96/UniPortrait models

# download ip-adapter models 

# Note: recommend downloading manually. We do not require all IP adapter models.

git clone https://huggingface.co/h94/IP-Adapter models/IP-Adapter

# then you can use the gradio app

python gradio_app.py

```

## Applications



## **Acknowledgements**

This code is built on some excellent repos, including [diffusers](https://github.com/huggingface/diffusers), [IP-Adapter](https://github.com/tencent-ailab/IP-Adapter) and [StyleAligned](https://github.com/google/style-aligned). Highly appreciate their great work!

## Cite

If you find UniPortrait useful for your research and applications, please cite us using this BibTeX:

```bibtex

@article{he2024uniportrait,

    title={UniPortrait: A Unified Framework for Identity-Preserving Single-and Multi-Human Image Personalization},

    author={He, Junjie and Geng, Yifeng and Bo, Liefeng},

    journal={arXiv preprint arXiv:2408.05939},

    year={2024}

}

```

For any question, please feel free to open an issue or contact us via [email protected].