Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/vladmandic/automatic

SD.Next: Advanced Implementation Generative Image Models
https://github.com/vladmandic/automatic

a1111-webui ai-art automatic1111 diffusers generative-art img2img sdnext stable-diffusion stable-diffusion-ai stable-diffusion-webui txt2img

Last synced: 4 days ago
JSON representation

SD.Next: Advanced Implementation Generative Image Models

Host: GitHub
URL: https://github.com/vladmandic/automatic
Owner: vladmandic
License: agpl-3.0
Created: 2022-12-24T20:59:11.000Z (almost 2 years ago)
Default Branch: master
Last Pushed: 2024-12-13T20:02:20.000Z (8 days ago)
Last Synced: 2024-12-16T12:17:45.064Z (5 days ago)
Topics: a1111-webui, ai-art, automatic1111, diffusers, generative-art, img2img, sdnext, stable-diffusion, stable-diffusion-ai, stable-diffusion-webui, txt2img
Language: Python
Homepage: https://vladmandic.github.io/sdnext-docs/
Size: 60.7 MB
Stars: 5,818
Watchers: 61
Forks: 440
Open Issues: 125
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING
- Funding: .github/FUNDING.yml
- License: LICENSE.txt
- Code of conduct: CODE_OF_CONDUCT
- Citation: CITATION.cff
- Security: SECURITY.md

Awesome Lists containing this project

awesome-stable-diffusion - automatic
AiTreasureBox - vladmandic/automatic - 12-20_5830_2](https://img.shields.io/github/stars/vladmandic/automatic.svg)|SD.Next: Advanced Implementation of Stable Diffusion and other Diffusion-based generative image models| (Repos)

README

        




**Image Diffusion implementation with advanced features**

![Last update](https://img.shields.io/github/last-commit/vladmandic/automatic?svg=true)

![License](https://img.shields.io/github/license/vladmandic/automatic?svg=true)

[![Discord](https://img.shields.io/discord/1101998836328697867?logo=Discord&svg=true)](https://discord.gg/VjvR2tabEX)

[![Sponsors](https://img.shields.io/static/v1?label=Sponsor&message=%E2%9D%A4&logo=GitHub&color=%23fe8e86)](https://github.com/sponsors/vladmandic)

[Wiki](https://github.com/vladmandic/automatic/wiki) | [Discord](https://discord.gg/VjvR2tabEX) | [Changelog](CHANGELOG.md)



## Table of contents

- [SD.Next Features](#sdnext-features)

- [Model support](#model-support)

- [Platform support](#platform-support)

- [Getting started](#getting-started)

## SD.Next Features

All individual features are not listed here, instead check [ChangeLog](CHANGELOG.md) for full list of changes

- Multiple UIs!  

  ▹ **Standard | Modern**  

- Multiple diffusion models!  

- Built-in Control for Text, Image, Batch and video processing!  

- Multiplatform!  

 ▹ **Windows | Linux | MacOS | nVidia | AMD | IntelArc/IPEX | DirectML | OpenVINO | ONNX+Olive | ZLUDA**

- Multiple backends!  

  ▹ **Diffusers | Original**  

- Platform specific autodetection and tuning performed on install  

- Optimized processing with latest `torch` developments with built-in support for `torch.compile`  

  and multiple compile backends: *Triton, ZLUDA, StableFast, DeepCache, OpenVINO, NNCF, IPEX, OneDiff*  

- Improved prompt parser  

- Built-in queue management  

- Enterprise level logging and hardened API  

- Built in installer with automatic updates and dependency management  

- Mobile compatible  




*Main interface using **StandardUI***:  

![screenshot-standardui](https://github.com/user-attachments/assets/cab47fe3-9adb-4d67-aea9-9ee738df5dcc)

*Main interface using **ModernUI***:  

![screenshot-modernui](https://github.com/user-attachments/assets/39e3bc9a-a9f7-4cda-ba33-7da8def08032)

For screenshots and informations on other available themes, see [Themes Wiki](https://github.com/vladmandic/automatic/wiki/Themes)




## Model support

Additional models will be added as they become available and there is public interest in them  

See [models overview](https://github.com/vladmandic/automatic/wiki/Models) for details on each model, including their architecture, complexity and other info  

- [RunwayML Stable Diffusion](https://github.com/Stability-AI/stablediffusion/) 1.x and 2.x *(all variants)*

- [StabilityAI Stable Diffusion XL](https://github.com/Stability-AI/generative-models), [StabilityAI Stable Diffusion 3.0](https://stability.ai/news/stable-diffusion-3-medium) Medium, [StabilityAI Stable Diffusion 3.5](https://huggingface.co/stabilityai/stable-diffusion-3.5-large) Medium, Large, Large Turbo

- [StabilityAI Stable Video Diffusion](https://huggingface.co/stabilityai/stable-video-diffusion-img2vid) Base, XT 1.0, XT 1.1

- [StabilityAI Stable Cascade](https://github.com/Stability-AI/StableCascade) *Full* and *Lite*

- [Black Forest Labs FLUX.1](https://blackforestlabs.ai/announcing-black-forest-labs/) Dev, Schnell  

- [AuraFlow](https://huggingface.co/fal/AuraFlow)

- [AlphaVLLM Lumina-Next-SFT](https://huggingface.co/Alpha-VLLM/Lumina-Next-SFT-diffusers)  

- [Playground AI](https://huggingface.co/playgroundai/playground-v2-256px-base) *v1, v2 256, v2 512, v2 1024 and latest v2.5*

- [Tencent HunyuanDiT](https://github.com/Tencent/HunyuanDiT)

- [OmniGen](https://arxiv.org/pdf/2409.11340)  

- [Meissonic](https://github.com/viiika/Meissonic)  

- [Kwai Kolors](https://huggingface.co/Kwai-Kolors/Kolors)  

- [CogView 3+](https://huggingface.co/THUDM/CogView3-Plus-3B)

- [LCM: Latent Consistency Models](https://github.com/openai/consistency_models)

- [aMUSEd](https://huggingface.co/amused/amused-256) 256 and 512

- [Segmind Vega](https://huggingface.co/segmind/Segmind-Vega), [Segmind SSD-1B](https://huggingface.co/segmind/SSD-1B), [Segmind SegMoE](https://github.com/segmind/segmoe) *SD and SD-XL*, [Segmind SD Distilled](https://huggingface.co/blog/sd_distillation) *(all variants)*

- [Kandinsky](https://github.com/ai-forever/Kandinsky-2) *2.1 and 2.2 and latest 3.0*

- [PixArt-α XL 2](https://github.com/PixArt-alpha/PixArt-alpha) *Medium and Large*, [PixArt-Σ](https://github.com/PixArt-alpha/PixArt-sigma)

- [Warp Wuerstchen](https://huggingface.co/blog/wuertschen)

- [Tsinghua UniDiffusion](https://github.com/thu-ml/unidiffuser)

- [DeepFloyd IF](https://github.com/deep-floyd/IF) *Medium and Large*

- [ModelScope T2V](https://huggingface.co/damo-vilab/text-to-video-ms-1.7b)

- [BLIP-Diffusion](https://dxli94.github.io/BLIP-Diffusion-website/)

- [KOALA 700M](https://github.com/youngwanLEE/sdxl-koala)

- [VGen](https://huggingface.co/ali-vilab/i2vgen-xl)

- [SDXS](https://github.com/IDKiro/sdxs)

- [Hyper-SD](https://huggingface.co/ByteDance/Hyper-SD)

## Platform support

- *nVidia* GPUs using **CUDA** libraries on both *Windows and Linux*  

- *AMD* GPUs using **ROCm** libraries on *Linux*  

  Support will be extended to *Windows* once AMD releases ROCm for Windows  

- *Intel Arc* GPUs using **OneAPI** with *IPEX XPU* libraries on both *Windows and Linux*  

- Any GPU compatible with *DirectX* on *Windows* using **DirectML** libraries  

  This includes support for AMD GPUs that are not supported by native ROCm libraries  

- Any GPU or device compatible with **OpenVINO** libraries on both *Windows and Linux*  

- *Apple M1/M2* on *OSX* using built-in support in Torch with **MPS** optimizations  

- *ONNX/Olive*  

- *AMD* GPUs on Windows using **ZLUDA** libraries

## Getting started

- Get started with **SD.Next** by following the [installation instructions](https://github.com/vladmandic/automatic/wiki/Installation)  

- For more details, check out [advanced installation](https://github.com/vladmandic/automatic/wiki/Advanced-Install) guide  

- List and explanation of [command line arguments](https://github.com/vladmandic/automatic/wiki/CLI-Arguments)

- Install walkthrough [video](https://www.youtube.com/watch?v=nWTnTyFTuAs)

> [!TIP]

> And for platform specific information, check out  

> [WSL](https://github.com/vladmandic/automatic/wiki/WSL) | [Intel Arc](https://github.com/vladmandic/automatic/wiki/Intel-ARC) | [DirectML](https://github.com/vladmandic/automatic/wiki/DirectML) | [OpenVINO](https://github.com/vladmandic/automatic/wiki/OpenVINO) | [ONNX & Olive](https://github.com/vladmandic/automatic/wiki/ONNX-Runtime) | [ZLUDA](https://github.com/vladmandic/automatic/wiki/ZLUDA) | [AMD ROCm](https://github.com/vladmandic/automatic/wiki/AMD-ROCm) | [MacOS](https://github.com/vladmandic/automatic/wiki/MacOS-Python.md) | [nVidia](https://github.com/vladmandic/automatic/wiki/nVidia)

> [!WARNING]

> If you run into issues, check out [troubleshooting](https://github.com/vladmandic/automatic/wiki/Troubleshooting) and [debugging](https://github.com/vladmandic/automatic/wiki/Debug) guides  

> [!TIP]

> All command line options can also be set via env variable

> For example `--debug` is same as `set SD_DEBUG=true`  

## Backend support

**SD.Next** supports two main backends: *Diffusers* and *Original*:

- **Diffusers**: Based on new [Huggingface Diffusers](https://huggingface.co/docs/diffusers/index) implementation  

  Supports *all* models listed below  

  This backend is set as default for new installations  

- **Original**: Based on [LDM](https://github.com/Stability-AI/stablediffusion) reference implementation and significantly expanded on by [A1111](https://github.com/AUTOMATIC1111/stable-diffusion-webui)  

  This backend and is fully compatible with most existing functionality and extensions written for *A1111 SDWebUI*  

  Supports **SD 1.x** and **SD 2.x** models  

  All other model types such as *SD-XL, LCM, Stable Cascade, PixArt, Playground, Segmind, Kandinsky, etc.* require backend **Diffusers**  

### Collab

- We'd love to have additional maintainers (with comes with full repo rights). If you're interested, ping us!  

- In addition to general cross-platform code, desire is to have a lead for each of the main platforms  

This should be fully cross-platform, but we'd really love to have additional contributors and/or maintainers to join and help lead the efforts on different platforms  

### Credits

- Main credit goes to [Automatic1111 WebUI](https://github.com/AUTOMATIC1111/stable-diffusion-webui) for original codebase  

- Additional credits are listed in [Credits](https://github.com/AUTOMATIC1111/stable-diffusion-webui/#credits)  

- Licenses for modules are listed in [Licenses](html/licenses.html)  

### Evolution



  

    

    

  



- [OSS Stats](https://ossinsight.io/analyze/vladmandic/automatic#overview)

### Docs

If you're unsure how to use a feature, best place to start is [Wiki](https://github.com/vladmandic/automatic/wiki) and if its not there,  

check [ChangeLog](CHANGELOG.md) for when feature was first introduced as it will always have a short note on how to use it  

### Sponsors