https://github.com/StevenShaw1999/RnB

https://github.com/StevenShaw1999/RnB

Last synced: about 1 month ago
JSON representation

• Host: GitHub
• URL: https://github.com/StevenShaw1999/RnB
• Owner: StevenShaw1999
• Created: 2023-11-27T06:53:28.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-11-29T13:33:25.000Z (over 1 year ago)
• Last Synced: 2024-08-01T18:37:46.641Z (9 months ago)
• Language: Python
• Size: 20.6 MB
• Stars: 18
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: Readme.md

Awesome Lists containing this project

• awesome-diffusion-categorized - [Code

README

        
# R&B: Region and Boundary Aware Zero-shot Grounded Text-to-image Generation

[[Website](https://attention-refocusing.github.io)]

## Environment Setup

Run the following command to set up the environment:

```buildoutcfg

conda create -n RnB python=3.8

conda activate RnB

pip install -r requirements.txt

```

## Grounded Generation with Text-to-image diffusion models

![Teaser figure](figures/Introduction.png)

## Framework

![Teaser figure](figures/method_new.png)

## Inference 

![Teaser figure](figures/comp.png)

Outputs including log file, generated images, config file,  are saved to path `./example_output`. Detail configuration can be found in the `./conf/base_config.yaml` and `inference.py`. You can set the `model_path` in `./conf/base_config.yaml` as your own path to SD checkpoint.

```buildoutcfg

python inference_RnB.py general.save_path=./example_output 

```

## Acknowledgments

This project is built on the following resources:

- [**Layout-guidance**](https://github.com/silent-chen/layout-guidance): Our code is built upon the previous work on grounded generation, thanks for their awesome codebase.