https://github.com/google/style-aligned

Official code for "Style Aligned Image Generation via Shared Attention"
https://github.com/google/style-aligned

Last synced: 1 day ago
JSON representation

Official code for "Style Aligned Image Generation via Shared Attention"

• Host: GitHub
• URL: https://github.com/google/style-aligned
• Owner: google
• License: apache-2.0
• Created: 2023-11-20T13:58:14.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2023-12-29T21:26:34.000Z (about 1 year ago)
• Last Synced: 2025-01-07T16:09:09.089Z (about 1 month ago)
• Language: Python
• Homepage:
• Size: 15.5 MB
• Stars: 1,248
• Watchers: 21
• Forks: 92
• Open Issues: 18
• Metadata Files:
  • Readme: README.md
  • Contributing: contributing.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-diffusion-categorized - [Code

README

        
# Style Aligned Image Generation via Shared Attention

### [Project Page](https://style-aligned-gen.github.io)   [Paper](https://style-aligned-gen.github.io/data/StyleAligned.pdf)

## Setup

This code was tested with Python 3.11, [Pytorch 2.1](https://pytorch.org/)  and [Diffusers 0.16](https://github.com/huggingface/diffusers).

## Examples

- See [**style_aligned_sdxl**][style_aligned] notebook for generating style aligned images using [SDXL](https://huggingface.co/docs/diffusers/using-diffusers/sdxl).

![alt text](doc/sa_example.jpg)

- See [**style_aligned_transfer_sdxl**][style_aligned_transfer] notebook for generating images with a style from reference image using [SDXL](https://huggingface.co/docs/diffusers/using-diffusers/sdxl).

![alt text](doc/sa_transfer_example.jpeg)

- See [**style_aligned_w_controlnet**][controlnet] notebook for generating style aligned and depth conditioned images using SDXL with [ControlNet-Depth](https://arxiv.org/abs/2302.05543).

![alt text](doc/cn_example.jpg)

-  [**style_aligned_w_multidiffusion**][multidiffusion] can be used for generating style aligned panoramas using [SD V2](https://huggingface.co/stabilityai/stable-diffusion-2) with [MultiDiffusion](https://multidiffusion.github.io/).

![alt text](doc/md_example.jpg)

## Demos

Thanks to @yvrjsharma for preparing the demos: [**style aligned text to image**][style_aligned_demo],  [**ControlNet + StyleAligned**][controlnet_demo] and  [**MultiDiffusion + StyleAligned**][controlnet_demo]

To start a demo locally, simply run

```

python .py  

```

and enter the demo in your browser using the provided url.

An online demo of ControlNet + StyleAligned is available [here](https://huggingface.co/spaces/ysharma/style-aligned-controlnet).

## TODOs

- [x] Adding demo.

- [x] StyleAligned from an input image.

- [ ] Multi-style with MultiDiffusion.

- [ ] StyleAligned with DreamBooth

## Disclaimer

This is not an officially supported Google product.

[style_aligned]: style_aligned_sdxl.ipynb

[controlnet]: style_aligned_w_controlnet.ipynb

[multidiffusion]: style_aligned_w_multidiffusion.ipynb

[style_aligned_transfer]: style_aligned_transfer_sdxl.ipynb

[style_aligned_demo]: demo_stylealigned_sdxl.py

[controlnet_demo]: demo_stylealigned_controlnet.py

[multidiffusion_demo]: demo_stylealigned_multidiffusion.py