https://github.com/Sealical/anywhere-multi-agent
https://github.com/Sealical/anywhere-multi-agent
Last synced: 3 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/Sealical/anywhere-multi-agent
- Owner: Sealical
- Created: 2024-04-29T03:43:39.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-05-28T10:59:58.000Z (about 1 year ago)
- Last Synced: 2024-10-31T00:40:10.678Z (8 months ago)
- Language: Jupyter Notebook
- Size: 8.25 MB
- Stars: 34
- Watchers: 4
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-diffusion-categorized - [Code
README
# Anywhere: A Multi-Agent Framework for Reliable and Diverse Foreground-Conditioned Image Inpainting
## Quick start
### Environment setup
```bash
git clone https://github.com/Sealical/anywhere-multi-agent.git
cd anywhere-multi-angent
conda create -n anywhere python=3.10 -y
conda activate anywhere
pip install -r requirements.txt
```
### Set-API-Key
Set up your API keys in `structJsonOutput.struct_text_generate.py` file
### Download & Set model path
- Download [RMBG-1.4](https://huggingface.co/briaai/RMBG-1.4/blob/main/model.pth) and set model path in `rmbgSegMask.py` file.
- Download [ControlNet_SDXL_canny](https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0), [RealVisXL_V4.0](https://huggingface.co/SG161222/RealVisXL_V4.0), [SDXL_inpainting](https://huggingface.co/diffusers/stable-diffusion-xl-1.0-inpainting-0.1) and set model path in `product2Image.py` file.
### Usage
See more details in `run_anywhere_pipeline.ipynb`
## Reference
```
@misc{xie2024anywhere,
title={Anywhere: A Multi-Agent Framework for Reliable and Diverse Foreground-Conditioned Image Inpainting},
author={Tianyidan Xie and Rui Ma and Qian Wang and Xiaoqian Ye and Feixuan Liu and Ying Tai and Zhenyu Zhang and Zili Yi},
year={2024},
eprint={2404.18598},
archivePrefix={arXiv},
primaryClass={cs.CV}
}
```