https://github.com/greengerong/ComfyUI-Lumina-Video
Lumina-Video
https://github.com/greengerong/ComfyUI-Lumina-Video
Last synced: about 2 months ago
JSON representation
Lumina-Video
- Host: GitHub
- URL: https://github.com/greengerong/ComfyUI-Lumina-Video
- Owner: greengerong
- License: apache-2.0
- Created: 2025-02-10T12:35:04.000Z (2 months ago)
- Default Branch: main
- Last Pushed: 2025-02-23T03:01:18.000Z (about 2 months ago)
- Last Synced: 2025-02-23T03:25:18.607Z (about 2 months ago)
- Language: Python
- Size: 3.96 MB
- Stars: 6
- Watchers: 2
- Forks: 1
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-comfyui - **ComfyUI-Lumina-Video**
README
# ComfyUI-Lumina-Video
这是一个用于ComfyUI的基于 [Lumina Video](https://github.com/Alpha-VLLM/Lumina-Video) 模型的视频生成非官方插件实现。
## 功能特点
- 支持文本到视频的生成
- 支持自定义分辨率和帧率（宽高都必须为32的倍数）
- 支持自定义系统提示词和负面提示词
- 支持多种精度模式 (bf16/fp16/fp32)
- 自动下载并管理所需模型
## 安装方法
1. 确保已安装 ComfyUI。（仅在linux 24GPU测试，估算16G可运行；欢迎issue反馈或pull request）
2. 克隆本仓库到 ComfyUI 的 custom_nodes 目录：
```bash
cd ComfyUI/custom_nodes
git clone https://github.com/greengerong/ComfyUI-Lumina-Video.git
pip install -r requirements.txt
```
另外加速还需安装`flash-attn`、`Apex`，参加文档[https://github.com/Alpha-VLLM/Lumina-Video/blob/main/INSTALL.md](https://github.com/Alpha-VLLM/Lumina-Video/blob/main/INSTALL.md)
3. 重启ComfyUI，模型将在首次运行时自动下载。手动下载模型，则可用网盘下载并与本地models目录合并。网盘地址：[https://pan.quark.cn/s/7663d2202040](https://pan.quark.cn/s/7663d2202040)。
* [Lumina-Video-f24R960](https://huggingface.co/Alpha-VLLM/Lumina-Video-f24R960) :下载模型并发至目录 /ComfyUI/models/Lumina-Video/Lumina-Video-f24R960
* [gemma-2-2b](https://huggingface.co/google/gemma-2-2b/tree/main) :下载模型并发至目录 /ComfyUI/models/LLM/gemma-2-2b
* [CogVideoX-2b vae](https://huggingface.co/THUDM/CogVideoX-2b/tree/main/vae) :下载vae目录模型并发至目录 /ComfyUI/models/CogVideo/CogVideoX-2b
## 使用方法
工作流见[./comfyui/workflows/Lumina-Video.json](./comfyui/workflows/Lumina-Video.json)
## 致谢
- [Lumina Video](https://github.com/Alpha-VLLM/Lumina-Video)
- [ComfyUI](https://github.com/comfyanonymous/ComfyUI)