Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/omniinfer/sd-webui-cloud-inference

Stable Diffusion(SDXL/Refiner)WebUI Cloud Inference Extension
https://github.com/omniinfer/sd-webui-cloud-inference

sdxl stable-diffusion stable-diffusion-api stable-diffusion-extension stable-diffusion-webui stable-diffusion-webui-plugin stable-diffusion-xl

Last synced: 13 days ago
JSON representation

Stable Diffusion(SDXL/Refiner)WebUI Cloud Inference Extension

Awesome Lists containing this project

README

        

# Stable Diffusion Web UI Cloud Inference

[![](https://dcbadge.vercel.app/api/server/nzqq8UScpx)](https://discord.gg/nzqq8UScpx)

[![IMAGE ALT TEXT HERE](https://img.youtube.com/vi/B8s2L_o3DrU/0.jpg)](https://www.youtube.com/watch?v=B8s2L_o3DrU)

## What capabilities does this extension offer?

This extension enables faster image generation without the need for expensive GPUs and seamlessly integrates with the AUTOMAIC1111 UI.

## Benefits:
1. **No expensive GPUs required**, can even use the CPU.
2. **No need to change your workflow**, compatible with the usage and scripts of sd-webui, such as X/Y/Z Plot, Prompt from file, etc.
3. **Support for 10000+ Checkpoint models**, don't need download

## Compatibility and Limitations

| Feature | Support | Limitations |
| -------------------------- | ------- | ----------- |
| txt2img | ✅ | |
| txt2img_hires.fix | ✅ | |
| txt2img_sdxl_refiner | ✅ | |
| txt2img_controlnet | ✅ | |
| img2img | ✅ | |
| img2img_inpaint | ✅ | |
| img2img_sdxl_refiner | ✅ | |
| img2img_controlnet | ✅ | |
| extras upscale | ✅ | |
| vae model | ✅ | |
| scripts - X/Y/Z plot | ✅ | |
| scripts - Prompt matrix | ✅ | |
| scripts - Prompt from file | ✅ | |

## How it works

![how it works](./docs/how-it-works.png)
## Guide
## 1. Install sd-webui-cloud-inference

![image-mh (4)](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/d187c9b2-ab64-40bf-8327-443db6a322c6)
![Screenshot 2023-07-26 at 14 40 49-mh](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/6c2d491d-b056-4f9a-b955-2a0b93c6afc4)
![Screenshot 2023-07-26 at 14 44 10-mh](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/1b8ec05a-2ec2-4da8-a0c8-bd10ac01e626)

## 2. Get your [omniinfer.io](https://www.omniinfer.io/user/login?utm_source=github_wiki) Key

Open [omniinfer.io](https://www.omniinfer.io/user/login?utm_source=github_wiki) in browser

We can choice "Google Login" or "Github Login"
image

![Screenshot 2023-07-26 at 14 44 10-mh](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/ae71a189-4d7c-4aea-a32f-d3a375b94b72)

## 3. Enable Cloud Inference feature

Let us back to `Cloud Inference` tab of stable-diffusion-webui

![Screenshot 2023-07-26 at 14 46 59-mh](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/3917f085-51b3-4ad2-8a84-539d074bf63a)

## 4. Test Txt2Img

Let us back to `Txt2Img` tab of stable-diffusion-webui

![Screenshot 2023-07-26 at 14 51 27-mh](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/cf2934d3-c5eb-4f7f-9485-04fafb832bbc)
From now on, you can give it a try and enjoy your creative journey.

Furthermore, you are welcome to freely discuss your user experience, share suggestions, and provide feedback on our Discord channel.
[![](https://dcbadge.vercel.app/api/server/nzqq8UScpx)](https://discord.gg/nzqq8UScpx)

## 5. Advanced - Lora

![Screenshot 2023-07-26 at 14 58 33-mh (1)](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/ebf4b5c9-189a-483c-b688-3bb2a19dbe8b)

## 7. Advanced - Img2img Inpainting
![image-mh](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/6681b6d8-9d3e-45c0-bfe3-57fad26cc5e6)
![Screenshot 2023-07-25 at 21 08 28-mh](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/286e45dc-ca3e-419a-98da-15d298f32e07)
![image-mh (4)](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/ed1d9d41-e0bf-4635-8423-ada83f03359e)
## 8. Advanced - VAE

![image](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/86abe84f-c34d-4e8d-8edc-920b6aaae050)

or you can use the VAE feature with X/Y/Z

![Screenshot 2023-07-25 at 22 35 30-mh](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/3dcb44df-c5a7-4fae-805d-5f69a1f2fb6e)

## 9. Advanced - ControlNet
![image-mh (2)](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/cd7ed643-831c-4999-94a1-9f9668e080cc)![Screenshot 2023-07-25 at 22 23 01-mh](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/db74e466-5e7f-421f-b33c-09802f5ee2c5)

# 9. Advanced - ControlNet
![image-mh (2)](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/cd7ed643-831c-4999-94a1-9f9668e080cc)![Screenshot 2023-07-25 at 22 23 01-mh](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/db74e466-5e7f-421f-b33c-09802f5ee2c5)

## 10. Advanced - Upscale and Hires.Fix
![Screenshot 2023-08-09 at 20 13 58-mh](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/15ac40f5-ad4b-4cc7-9927-4cc82a90f853)

![Screenshot 2023-08-09 at 20 16 18-mh](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/1e606dd5-51aa-4eea-baba-f78849104591)

## 11. Advanced - Model Browser

![Screenshot 2023-08-27 at 17 03 48-mh](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/ad586862-ac5f-4689-a166-d1d7d654a9f1)

## 12. Advanced - Tiny Model

The AUTOMATIC1111 webui loads the model on startup. However, on low-memory computers like the MacBook Air, the performance is suboptimal. To address this, we have developed a stripped-down minimal-size model. You can utilize the following commands to enable it.

its will reduce memory from 4.8G -> 739MB

1. Download tiny model and config to model config.
```
wget -O ./models/Stable-diffusion/tiny.yaml https://github.com/omniinfer/sd-webui-cloud-inference/releases/download/tiny-model/tiny.yaml
wget -O ./models/Stable-diffusion/tiny.safetensors https://github.com/omniinfer/sd-webui-cloud-inference/releases/download/tiny-model/tiny.safetensors
```
2. start webui with tiny model
`--ckpt=/stable-diffusion-webui/models/Stable-diffusion/tiny.safetensors`

## 13. Advanced - SDXL Refiner

![Screenshot 2023-09-04 at 13 45 24-mh](https://github.com/omniinfer/sd-webui-cloud-inference/assets/16937838/f8537240-c2a0-4ed3-84c0-70dd23764add)