https://github.com/MinusZoneAI/ComfyUI-CogVideoX-MZ
CogVideoX-5B 4-bit quantization model
https://github.com/MinusZoneAI/ComfyUI-CogVideoX-MZ
cogvideox comfyui comfyui-nodes dit
Last synced: about 2 months ago
JSON representation
CogVideoX-5B 4-bit quantization model
- Host: GitHub
- URL: https://github.com/MinusZoneAI/ComfyUI-CogVideoX-MZ
- Owner: MinusZoneAI
- License: gpl-3.0
- Created: 2024-08-13T12:27:40.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-10-30T10:52:42.000Z (12 months ago)
- Last Synced: 2024-10-30T11:37:34.516Z (12 months ago)
- Topics: cogvideox, comfyui, comfyui-nodes, dit
- Language: Python
- Homepage:
- Size: 2.37 MB
- Stars: 81
- Watchers: 1
- Forks: 3
- Open Issues: 22
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-comfyui - **ComfyUI-CogVideoX-MZ**
- awesome-comfyui - **ComfyUI-CogVideoX-MZ**
- awesome-comfyui - **ComfyUI-CogVideoX-MZ**
README
# ComfyUI-CogVideoX-MZ
在 https://github.com/kijai/ComfyUI-CogVideoXWrapper 的基础上增加一个独立的模型加载器和一些其他的功能, 使用前需要先安装ComfyUI-CogVideoXWrapper
Based on https://github.com/kijai/ComfyUI-CogVideoXWrapper add model loader and some other features, you need to install ComfyUI-CogVideoXWrapper before using
## Update - 2024-09-24
添加vae encode tiling开关, 在16G显存下可以生成1024分辨率的视频不会OOM
(add vae encode tiling switch, can generate 1024 resolution video without OOM on 16G vram)
## Update - 2024-09-22
支持CogVideoX-I2V图生视频, 提供Q4量化模型
(support CogVideoX-I2V image to video, provide Q4 quantization model)
[CogVideoX_5b_I2V_GGUF_Q4_0.safetensors](https://huggingface.co/Kijai/CogVideoX_GGUF/resolve/main/CogVideoX_5b_I2V_GGUF_Q4_0.safetensors) 下载到unet文件夹 (Donwload to unet folder)
工作流在examples\workflow_I2V_GGUF_Q4_0.png (Workflow in examples\workflow_I2V_GGUF_Q4_0.png)
Prompt :The girl in the video happily puts on sunglasses.
https://github.com/user-attachments/assets/3eae12b7-1a2d-40c5-b6fb-10afb1349f4e
## Update - 2024-09-19
支持CogVideoX-Fun图生视频, 提供Q4量化模型
(support CogVideoX-Fun image to video, provide Q4 quantization model)
[CogVideoX_Fun_GGUF_Q4_0.safetensors](https://modelscope.cn/models/wailovet/CogVideoX-5b/resolve/master/CogVideoX_5b_fun_GGUF_Q4_0.safetensors) 下载到unet文件夹 (Donwload to unet folder)
工作流在examples\workflow_FUN_I2V_GGUF_Q4_0.png (Workflow in examples\workflow_FUN_I2V_GGUF_Q4_0.png)
Prompt :The girl in the video happily puts on sunglasses.
https://github.com/user-attachments/assets/32101df0-d50c-404a-a2ea-3ddff0dcc59b
## Update - 2024-09-05
部分层4位量化模型, 采样方式选择DPM, weight_dtype选择GGUF, cpu_offload不启用分辨率480x720在32帧下占用显存小于8G
(CogVideoX-5B 4-bit quantization model, when using it, the sampling method needs to select DPM, weight_dtype selects GGUF, and cpu_offload is not enabled)
[CogVideoX_5b_GGUF_Q4_0.safetensors](https://modelscope.cn/models/wailovet/CogVideoX-5b/resolve/master/CogVideoX_5b_GGUF_Q4_0.safetensors) 下载到unet文件夹
4位量化工作流在examples\workflow_GGUF_Q4_0.png
## 使用
CogVideoX-5B的模型加载器
依赖 https://github.com/kijai/ComfyUI-CogVideoXWrapper
模型下载地址
[CogVideoX_5b_fp8_4em.safetensors](https://modelscope.cn/models/wailovet/CogVideoX-5b/resolve/master/CogVideoX_5b_fp8_4em.safetensors) 下载到unet文件夹
[diffusion_pytorch_model.safetensors](https://modelscope.cn/models/zhipuai/cogvideox-5b/resolve/master/vae/diffusion_pytorch_model.safetensors) 下载到vae文件夹(记得重命名文件名方便辨认)
[t5xxl_fp8_e4m3fn.safetensors](https://modelscope.cn/models/ai-modelscope/flux_text_encoders/resolve/master/t5xxl_fp8_e4m3fn.safetensors) 下载到clip文件夹(和sd3/flux通用,不需要重复下载)
工作流在examples/*.png
## Usage
CogVideoX-5B model loader
Depends on https://github.com/kijai/ComfyUI-CogVideoXWrapper
Model download address
[CogVideoX_5b_fp8_4em.safetensors](https://modelscope.cn/models/wailovet/CogVideoX-5b/resolve/master/CogVideoX_5b_fp8_4em.safetensors) Download to unet folder
[diffusion_pytorch_model.safetensors](https://modelscope.cn/models/zhipuai/cogvideox-5b/resolve/master/vae/diffusion_pytorch_model.safetensors) Download to vae folder (remember to rename the file name for easy identification)
[t5xxl_fp8_e4m3fn.safetensors](https://modelscope.cn/models/ai-modelscope/flux_text_encoders/resolve/master/t5xxl_fp8_e4m3fn.safetensors) Download to clip folder (universal with sd3/flux, no need to download repeatedly)
Workflow in examples/*.png
## Credits
- [CogVideo](https://github.com/THUDM/CogVideo)
- [CogVideoX-Fun](https://github.com/aigc-apps/CogVideoX-Fun)
- [ComfyUI-CogVideoXWrapper](https://github.com/kijai/ComfyUI-CogVideoXWrapper)