Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/shiimizu/ComfyUI_smZNodes
Custom nodes for ComfyUI such as CLIP Text Encode++
https://github.com/shiimizu/ComfyUI_smZNodes
comfyui stable-diffusion
Last synced: about 2 months ago
JSON representation
Custom nodes for ComfyUI such as CLIP Text Encode++
- Host: GitHub
- URL: https://github.com/shiimizu/ComfyUI_smZNodes
- Owner: shiimizu
- License: gpl-3.0
- Created: 2023-07-03T01:10:19.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-07-14T07:15:32.000Z (2 months ago)
- Last Synced: 2024-07-15T07:46:55.870Z (2 months ago)
- Topics: comfyui, stable-diffusion
- Language: Python
- Homepage:
- Size: 263 KB
- Stars: 167
- Watchers: 3
- Forks: 12
- Open Issues: 24
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-comfyui - smzNodes
README
# smZNodes
A selection of custom nodes for [ComfyUI](https://github.com/comfyanonymous/ComfyUI).
1. [CLIP Text Encode++](#clip-text-encode)
2. [Settings](#settings)
Contents
* [Tips to get reproducible results on both UIs](#tips-to-get-reproducible-results-on-both-uis)
* [FAQs](#faqs)
* [Installation](#installation)
## CLIP Text Encode++
CLIP Text Encode++ can generate identical embeddings from [stable-diffusion-webui](https://github.com/AUTOMATIC1111/stable-diffusion-webui) for [ComfyUI](https://github.com/comfyanonymous/ComfyUI).
This means you can reproduce the same images generated from `stable-diffusion-webui` on `ComfyUI`.
Simple prompts generate _identical_ images. More complex prompts with complex attention/emphasis/weighting may generate images with slight differences. In that case, you can try using the `Settings` node to match outputs.
### Features
- [Prompt editing](https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Features#prompt-editing)
- [Alternating words](https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Features#alternating-words)
- [`AND`](https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Features#composable-diffusion) keyword (similar to the ConditioningCombine node)
- [`BREAK`](https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Features#break-keyword) keyword (same as the ConditioningConcat node)
- Weight normalization
- Optional `embedding:` identifier
### Comparisons
These images can be dragged into ComfyUI to load their workflows. Each image is done using the [Silicon29](https://huggingface.co/Xynon/SD-Silicon) (in SD v1.5) checkpoint with 18 steps using the Heun sampler.
|stable-diffusion-webui|A1111 parser|Comfy parser|
|:---:|:---:|:---:|
|  |  |  |
|  |  |  |
Image slider links:
- https://imgsli.com/MTkxMjE0
- https://imgsli.com/MTkxMjEy
### Options
|Name|Description|
| --- | --- |
| `parser` | The parser to parse prompts into tokens and then transformed (encoded) into embeddings. Taken from [SD.Next](https://github.com/vladmandic/automatic/discussions/99#discussioncomment-5931014). |
| `mean_normalization` | Whether to take the mean of your prompt weights. It's `true` by default on `stable-diffusion-webui`.
This is implemented according to how it is in `stable-diffusion-webui`. |
| `multi_conditioning` |
For each prompt, the list is obtained by splitting the prompt using the `AND` separator.
See: [Compositional Visual Generation with Composable Diffusion Models](https://energy-based-model.github.io/Compositional-Visual-Generation-with-Composable-Diffusion-Models/)
- a way to use multiple prompts at once
- allows `AND` in the negative prompt as well
- supports weights for prompts: `a cat :1.2 AND a dog AND a penguin :2.2`. The weights default to 1
- each prompt gets a cfg value of `cfg * weight / N`, where `N` is the number of positive prompts. In `stable-diffusion-webui`, each prompt gets a cfg value of `cfg * weight`. To match their behaviour, you can add a weight of `:N` to every prompt _or_ simply set a cfg value of `cfg * N`
|`use_old_emphasis_implementation`|
Use old emphasis implementation. Can be useful to reproduce old seeds.|
> [!TIP]
> You can right click the node to show/hide some of the widgets. E.g. the `with_SDXL` option.
| Parser | Description |
| ----------------- | -------------------------------------------------------------------------------- |
| `comfy` | The default way `ComfyUI` handles everything |
| `comfy++` | Uses `ComfyUI`'s parser but encodes tokens the way `stable-diffusion-webui` does, allowing to take the mean as they do. |
| `A1111` | The default parser used in `stable-diffusion-webui` |
| `full` | Same as `A1111` but whitespaces, newlines, and special characters are stripped |
| `compel` | Uses [`compel`](https://github.com/damian0815/compel) |
| `fixed attention` | Prompt is untampered with |
> [!IMPORTANT]
> Every `parser` except `comfy` uses `stable-diffusion-webui`'s encoding pipeline.
> [!WARNING]
> LoRA syntax (``) is not suppprted.
## Settings
Settings node showcase
The `Settings` node is a dynamic node functioning similar to the Reroute node and is used to fine-tune results during sampling or tokenization. The inputs can be replaced with another input type even after it's been connected. `CLIP` inputs only apply settings to CLIP Text Encode++. Settings apply locally based on its links just like nodes that do model patches. I made this node to explore the various settings found in `stable-diffusion-webui`.
This node can change whenever it is updated, so you may have to **recreate** it to prevent issues. Settings can be overridden by using another `Settings` node somewhere past a previous one. Right click the node for the `Hide/show all descriptions` menu option.
## Tips to get reproducible results on both UIs
- Use the same seed, sampler settings, RNG (CPU or GPU), clip skip (CLIP Set Last Layer), etc.
- Ancestral and SDE samplers may not be deterministic.
- If you're using `DDIM` as your sampler, use the `ddim_uniform` scheduler.
- There are different `unipc` configurations. Adjust accordingly on both UIs.
## FAQs
- How does this differ from [`ComfyUI_ADV_CLIP_emb`](https://github.com/BlenderNeko/ComfyUI_ADV_CLIP_emb)?
- While the weights are normalized in the same manner, the tokenization and encoding pipeline that's taken from stable-diffusion-webui differs from ComfyUI's. These small changes add up and ultimately produces different results.
- Where can I learn more about how ComfyUI interprets weights?
- https://comfyanonymous.github.io/ComfyUI_examples/faq/
- https://blenderneko.github.io/ComfyUI-docs/Interface/Textprompts/
- [comfyui.creamlab.net)](https://comfyui.creamlab.net/guides/f_text_prompt)
## Installation
Three methods are available for installation:
1. Load via [ComfyUI Manager](https://github.com/ltdrdata/ComfyUI-Manager)
2. Clone the repository directly into the extensions directory.
3. Download the project manually.
### Load via ComfyUI Manager
Install via ComfyUI Manager
### Clone Repository
```shell
cd path/to/your/ComfyUI/custom_nodes
git clone https://github.com/shiimizu/ComfyUI_smZNodes.git
```
### Download Manually
1. Download the project archive from [here](https://github.com/shiimizu/ComfyUI_smZNodes/archive/refs/heads/main.zip).
2. Extract the downloaded zip file.
3. Move the extracted files to `path/to/your/ComfyUI/custom_nodes`.
4. Restart ComfyUI
The folder structure should resemble: `path/to/your/ComfyUI/custom_nodes/ComfyUI_smZNodes`.
### Update
To update the extension, update via [ComfyUI Manager](https://github.com/ltdrdata/ComfyUI-Manager) or pull the latest changes from the repository:
```shell
cd path/to/your/ComfyUI/custom_nodes/ComfyUI_smZNodes
git pull
```
## Credits
* [AUTOMATIC1111](https://github.com/AUTOMATIC1111) / [stable-diffusion-webui](https://github.com/AUTOMATIC1111/stable-diffusion-webui)
* [comfyanonymous](https://github.com/comfyanonymous) / [ComfyUI](https://github.com/comfyanonymous/ComfyUI)