https://github.com/freedomintelligence/medgen
MedGen: Unlocking Medical Video Generation by Scaling Granularly-annotated Medical Videos.
https://github.com/freedomintelligence/medgen
Last synced: 3 months ago
JSON representation
MedGen: Unlocking Medical Video Generation by Scaling Granularly-annotated Medical Videos.
- Host: GitHub
- URL: https://github.com/freedomintelligence/medgen
- Owner: FreedomIntelligence
- License: apache-2.0
- Created: 2025-04-18T15:31:35.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2025-07-09T03:25:39.000Z (11 months ago)
- Last Synced: 2025-09-14T02:50:04.122Z (9 months ago)
- Homepage:
- Size: 230 KB
- Stars: 22
- Watchers: 12
- Forks: 1
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Unlocking Medical Video Generation by Scaling Granularly-annotated Medical Videos
[📃 Paper] ｜ [🤗 Dataset] ｜ [🤗 Model (coming)] ｜ [🚀 Blog]
## 🛎️ News
* **`Jul 8, 2025`:** We released our `paper`, `data` and `project`. Models are coming soon. Please stay tuned!
## ⚡ Introduction
Recent advances in video generation have shown remarkable progress in open-domain settings, yet medical video generation remains largely underexplored. Medical videos are critical for applications such as clinical training, education, and simulation, requiring not only high visual fidelity but also strict medical accuracy. However, current models often produce unrealistic or erroneous content when applied to medical prompts, largely due to the lack of large-scale, high-quality datasets tailored to the medical domain. To address this gap, we introduce **MedVideoCap-55K**, the first large-scale, diverse, and caption-rich dataset for medical video generation. It comprises over 55,000 curated clips spanning real-world medical scenarios, providing a strong foundation for training generalist medical video generation models. Built upon this dataset, we develop **MedGen**, which achieves leading performance among open-source models and rivals commercial systems across multiple benchmarks in both visual quality and medical accuracy.
We hope our dataset and model can serve as a valuable resource and help catalyze further research in medical video generation.
> [!NOTE]
> We open-sourced our models, data, and code here.
## 📚 Data
You can [⬇️download our full MedVideoCap-55K](https://huggingface.co/datasets/FreedomIntelligence/MedVideoCap-55K) from HuggingFace. Our dataset has several features:
1. **Superior in quantity**. Our dataset comprising 55k medical videos. Supporting video generation across various medical scenarios, it includes medical education, medical imaging, clinical practice, and more.
2. **Superior in visual quality**. Our dataset is strictly selected from the aspects of aesthetics, temporal consistency, motion smoothness, and clarity assessment.
3. **Expressive in caption**. Previously proposed medical video datasets typically use category labels as captions. In contrast, our dataset provides expressive and coherent video descriptions with the help of MLLMs.
## 🤩 Acknowledgement
Our works are inspired by the following works.
- [FastVideo](https://github.com/hao-ai-lab/FastVideo): a lightweight framework for accelerating large video diffusion models.
- [VBench](https://github.com/Vchitect/VBench): a comprehensive benchmark suite for video generative models.
- [VideoScore](https://github.com/TIGER-AI-Lab/VideoScore): a automatic metrics to simulate fine-grained human feedback for video generation.
## 📖 Citation
```
@misc{wang2025medgenunlockingmedicalvideo,
title={MedGen: Unlocking Medical Video Generation by Scaling Granularly-annotated Medical Videos},
author={Rongsheng Wang and Junying Chen and Ke Ji and Zhenyang Cai and Shunian Chen and Yunjin Yang and Benyou Wang},
year={2025},
eprint={2507.05675},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2507.05675},
}
```