https://github.com/XLearning-SCU/Awesome-All-In-One-Image-Restoration
This is a summary of research on All-In-One Image/Video Restoration. There may be omissions. If anything is missing please get in touch with us. Our emails: [email protected]; [email protected]; [email protected]; [email protected]
https://github.com/XLearning-SCU/Awesome-All-In-One-Image-Restoration
List: Awesome-All-In-One-Image-Restoration
all-in-one-image-restoration all-in-one-video-restoration image-restoration video-restoration
Last synced: 3 months ago
JSON representation
This is a summary of research on All-In-One Image/Video Restoration. There may be omissions. If anything is missing please get in touch with us. Our emails: [email protected]; [email protected]; [email protected]; [email protected]
- Host: GitHub
- URL: https://github.com/XLearning-SCU/Awesome-All-In-One-Image-Restoration
- Owner: XLearning-SCU
- Created: 2024-04-24T13:05:28.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2025-01-14T12:53:09.000Z (4 months ago)
- Last Synced: 2025-01-14T13:54:58.142Z (4 months ago)
- Topics: all-in-one-image-restoration, all-in-one-video-restoration, image-restoration, video-restoration
- Homepage:
- Size: 28.3 KB
- Stars: 151
- Watchers: 2
- Forks: 5
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- ultimate-awesome - Awesome-All-In-One-Image-Restoration - This is a summary of research on All-In-One Image/Video Restoration. There may be omissions. If anything is missing please get in touch with us. Our emails: [email protected]; [email protected]; [email protected]; [email protected]. (Other Lists / Julia Lists)
README
# Awesome-All-In-One-Image-Restoration (Updating)
This curated list of papers related to all-in-one image/video restoration. All-in-one image/video restoration aims to handle multiple degradations with one model [[1]](#AirNet).
We mark works contributed by ourselves with ⭐.
*This repository now is maintained by [Boyun Li](https://liboyun.github.io/), [Yuanbiao Gou](https://ybgou.github.io/) and [Haiyu Zhao](https://pandint.github.io/about/), feel free to contact us if you have any questions.*
# TODO
## Table of Contents
- [All-In-One Image Restoration](#All-in-one-image-restoration)
- [Open-set Image Restoration](#Open-set-Image-Restoration)
- [All-In-One Image Restoration](#All-In-One-Image-Restoration)
- [All-In-One Video Restoration](#All-In-One-Video-Restoration)
- [Misc](#Misc)
## All-In-One Image Restoration
### Open-set Image Restoration
- `[2024 ICML]` ⭐ **Test-Time Degradation Adaption for Open-Set Image Restoration**
*Yuanbiao Gou, Haiyu Zhao, Boyun Li, Xinyan Xiao, Xi Peng*
[[paper]](https://arxiv.org/abs/2312.02197) [[code]](https://github.com/XLearning-SCU/2024-ICML-TAO)
### All-In-One Image Restoration
#### 2022
- `[2022 CVPR]` ⭐ **All-In-One Image Restoration for Unknown Corruption**
*Boyun Li, Xiao Liu, Peng Hu, Zhongqin Wu, Jiancheng Lv, Xi Peng*
[[paper]](http://pengxi.me/wp-content/uploads/2022/03/All-In-One-Image-Restoration-for-Unknown-Corruption.pdf) [[code]](https://github.com/XLearning-SCU/2022-CVPR-AirNet.git) [](https://github.com/XLearning-SCU/2022-CVPR-AirNet)
- `[2022 CVPR]` **TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions**
*Jeya Maria Jose Valanarasu, Rajeev Yasarla, Vishal M. Patel*
[[paper]](https://arxiv.org/abs/2111.14813) [[code]](https://github.com/jeya-maria-jose/TransWeather.git)
#### 2023
- `[2023 NeurIPS]` **PromptIR: Prompting for All-in-One Blind Image Restoration**
*Vaishnav Potlapalli, Syed Waqas Zamir, Salman Khan, Fahad Shahbaz Khan*
[[paper]](https://arxiv.org/abs/2306.13090) [[code]](https://github.com/va1shn9v/PromptIR.git)
- `[2023 CVPR]` **Ingredient-oriented Multi-Degradation Learning for Image Restoration**
*Jinghao Zhang, Jie Huang, Mingde Yao, Zizheng Yang, Hu Yu, Man Zhou, Feng Zhao*
[[paper]](https://openaccess.thecvf.com/content/CVPR2023/papers/Zhang_Ingredient-Oriented_Multi-Degradation_Learning_for_Image_Restoration_CVPR_2023_paper.pdf) [[code]](https://github.com/JingHao99/IDR-Ingredients-oriented-Degradation-Reformulation.git)
- `[2023 ICCV]` **Adverse Weather Removal with Codebook Priors**
*Tian Ye, Sixiang Chen, Jinbin Bai, Jun Shi, Chenghao Xue, Jingxia Jiang, Junjie Yin, Erkang Chen, Yun Liu*
[[paper]](https://openaccess.thecvf.com/content/ICCV2023/papers/Ye_Adverse_Weather_Removal_with_Codebook_Priors_ICCV_2023_paper.pdf) [[code]](https://github.com/Owen718/AWRCP.git)
- `[2023 TPAMI]` **Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models**
*Ozan Özdenizci, Robert Legenstein*
[[paper]](https://arxiv.org/abs/2207.14626) [[code]](https://github.com/IGITUGraz/WeatherDiffusion.git)
- `[2023 Arxiv]` **Multimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restoration**
*Yuang Ai, Huaibo Huang, Xiaoqiang Zhou, Jiexiang Wang, Ran He*
[[paper]](https://arxiv.org/abs/2312.02918)
- `[2023 Arxiv]` **Prompt-In-Prompt Learning for Universal Image Restoration**
*Zilong Li, Yiming Lei, Chenglong Ma, Junping Zhang, Hongming Shan*
[[paper]](https://arxiv.org/abs/2312.05038v1) [[code]](https://github.com/longzilicart/pip_universal)
- `[2023 Arxiv]` **RDM-IR: Task-Adaptive Deep Unfolding Network for All-In-One Image Restoration**
*Yuanshuo Cheng, Mingwen Shao, Yecong Wan, Chao Wang*
[[paper]](https://arxiv.org/abs/2307.07688) [[code]](https://github.com/YuanshuoCheng/RDM-IR)
- `[2023 Arxiv]` **Language-driven All-in-one Adverse Weather Removal**
*Hao Yang, Liyuan Pan, Yan Yang, Wei Liang*
[[paper]](https://arxiv.org/abs/2312.01381)
- `[2023 Arxiv]` **Always Clear Days: Degradation Type and Severity Aware All-In-One Adverse Weather Removal**
*Yu-Wei Chen, Soo-Chang Pei*
[[paper]](https://arxiv.org/abs/2310.18293) [[code]](https://github.com/fordevoted/UtilityIR)
#### 2024
- `[2024 ICLR]` **Controlling Vision-Language Models for Universal Image Restoration**
*Ziwei Luo, Fredrik K. Gustafsson, Zheng Zhao, Jens Sjölund, Thomas B. Schön*
[[paper]](https://arxiv.org/abs/2310.01018) [[code]](https://github.com/Algolzw/daclip-uir.git)
- `[2024 CVPR]` **Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model**
*Dian Zheng, Xiao-Ming Wu, Shuzhou Yang, Jian Zhang, Jian-Fang Hu, Wei-Shi Zheng*
[[paper]](https://arxiv.org/abs/2403.11157) [[code]](https://github.com/iSEE-Laboratory/DiffUIR?tab=readme-ov-file)
- `[2024 ECCV]` **Restoring Images in Adverse Weather Conditions via Histogram Transformer**
*Shangquan Sun, Wenqi Ren, Xinwei Gao, Rui Wang, Xiaochun Cao*
[[paper]](https://arxiv.org/abs/2407.10172) [[code]](https://github.com/sunshangquan/Histoformer)
- `[2024 ECCV]` **AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion**
*Yitong Jiang, Zhaoyang Zhang, Tianfan Xue, Jinwei Gu*
[[paper]](https://arxiv.org/pdf/2310.10123) [[code]](https://github.com/jiangyitong/AutoDIR.git)
- `[2024 ACM MM]` **Learning A Low-Level Vision Generalist via Visual Task Prompt**
*Xiangyu Chen, Yihao Liu, Yuandong Pu, Wenlong Zhang, Jiantao Zhou, Yu Qiao, Chao Dong*
[[paper]](http://arxiv.org/abs/2408.08601) [[code]](https://github.com/chxy95/GenLV)
- `[2024 MICCAI]` **All-In-One Medical Image Restoration via Task-Adaptive Routing**
*Zhiwen Yang, Haowei Chen, Ziniu Qian, Yang Yi, Hui Zhang, Dan Zhao, Bingzheng Wei, Yan Xu*
[[paper]](https://arxiv.org/abs/2405.19769) [[code]](https://github.com/Yaziwel/All-In-One-Medical-Image-Restoration-via-Task-Adaptive-Routing)
- `[2024 Arxiv]` **AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulation**
*Yuning Cui, Syed Waqas Zamir, Salman Khan, Alois Knoll, Mubarak Shah, Fahad Shahbaz Khan*
[[paper]](https://arxiv.org/abs/2403.14614) [[code]](https://github.com/c-yn/AdaIR.git)
### Non-Blind All-In-One Image Restoration
#### 2020
- `[2020 CVPR]` **All in One Bad Weather Removal Using Architectural Search**
*Ruoteng Li, Robby T. Tan, Loong-Fah Cheong*
[[paper]](https://openaccess.thecvf.com/content_CVPR_2020/html/Li_All_in_One_Bad_Weather_Removal_Using_Architectural_Search_CVPR_2020_paper.html)
#### 2021
- `[2021 CVPR]` **Pre-Trained Image Processing Transformer**
*Hanting Chen, Yunhe Wang, Tianyu Guo, Chang Xu, Yiping Deng, Zhenhua Liu, Siwei Ma, Chunjing Xu, Chao Xu, Wen Gao*
[[paper]](https://arxiv.org/abs/2012.00364) [[code]](https://github.com/huawei-noah/Pretrained-IPT.git)
- `[2021 TPAMI]` **A General Decoupled Learning Framework for Parameterized Image Operators**
*Qingnan Fan, Dongdong Chen, Lu Yuan, Gang Hua, Nenghai Yu, Baoquan Chen*
[[paper]](https://arxiv.org/abs/1907.05852) [[code]](https://github.com/fqnchina/DecoupleLearning.git)
#### 2022
- `[2022 ECCV]` **TAPE: Task-Agnostic Prior Embedding for Image Restoration**
*Lin Liu, Lingxi Xie, Xiaopeng Zhang, Shanxin Yuan, Xiangyu Chen, Wengang Zhou, Houqiang Li, Qi Tian*
[[paper]](https://arxiv.org/abs/2203.06074) [[code]](http://home.ustc.edu.cn/~ll0825/project_TAPE.html)
#### 2023
- `[2023 CVPR]` **Generative Diffusion Prior for Unified Image Restoration and Enhancement**
*Ben Fei, Zhaoyang Lyu, Liang Pan, Junzhe Zhang, Weidong Yang, Tianyue Luo, Bo Zhang, Bo Dai*
[[paper]](https://arxiv.org/abs/2304.01247) [[code]](https://github.com/Fayeben/GenerativeDiffusionPrior.git)
- `[2023 CVPR]` **Learning Weather-General and Weather-Specific Features for Image Restoration Under Multiple Adverse Weather Conditions**
*Yurui Zhu, Tianyu Wang, Xueyang Fu, Xuanyu Yang, Xin Guo, Jifeng Dai, Yu Qiao, Xiaowei Hu*
[[paper]](https://openaccess.thecvf.com/content/CVPR2023/papers/Zhu_Learning_Weather-General_and_Weather-Specific_Features_for_Image_Restoration_Under_Multiple_CVPR_2023_paper.pdf) [[code]](https://github.com/zhuyr97/WGWS-Net.git)
- `[2023 IJCAI]` **On Efficient Transformer-Based Image Pre-training for Low-Level Vision**
*Wenbo Li, Xin Lu, Shengju Qian, Jiangbo Lu, Xiangyu Zhang, Jiaya Jia*
[[paper]](https://arxiv.org/abs/2112.10175) [[code]](https://github.com/fenglinglwb/EDT.git)
- `[2023 Arxiv]` **Exploring Degradation-aware Visual Prompt for Universal Image Restoration**
*Jiaqi Ma, Tianheng Cheng, Guoli Wang, Qian Zhang, Xinggang Wang, Lefei Zhang*
[[paper]](https://arxiv.org/abs/2306.13653) [[code]](https://github.com/leonmakise/ProRes.git)
#### 2024
- `[2024 ECCV]` **InstructIR: High-Quality Image Restoration Following Human Instructions**
*Marcos V. Conde, Gregor Geigle, Radu Timofte*
[[paper]](https://arxiv.org/abs/2401.16468) [[code]](https://github.com/mv-lab/InstructIR.git)
## All-In-One Video Restoration
#### 2023
- `[2023 ICCV]` **Video Adverse-Weather-Component Suppression Network via Weather Messenger and Adversarial Backpropagation**
*Yijun Yang, Angelica I. Aviles-Rivero, Huazhu Fu, Ye Liu, Weiming Wang, Lei Zhu*
[[paper]](https://openaccess.thecvf.com/content/ICCV2023/html/Yang_Video_Adverse-Weather-Component_Suppression_Network_via_Weather_Messenger_and_Adversarial_Backpropagation_ICCV_2023_paper.html) [[code]](https://github.com/scott-yjyang/ViWS-Net.git)
- `[2023 Arxiv]` **Cross-Consistent Deep Unfolding Network for Adaptive All-In-One Video Restoration**
*Yuanshuo Cheng, Mingwen Shao, Yecong Wan, Yuanjian Qiao, Wangmeng Zuo, Deyu Meng*
[[paper]](https://arxiv.org/abs/2309.01627)
#### 2024
- `[2024 NeurIPS]` ⭐ **AverNet: All-in-one Video Restoration for Time-varying Unknown Degradations**
*Haiyu Zhao, Lei Tian, Xinyan Xiao, Peng Hu, Yuanbiao Gou, Xi Peng*
[[paper]](https://openreview.net/pdf/cd985f5642f31d02e47d062bc783deb7c2d1fa8a.pdf) [[code]](https://github.com/XLearning-SCU/2024-NeurIPS-AverNet)
- `[2024 CVPR]` **Genuine Knowledge from Practice: Diffusion Test-Time Adaptation for Video Adverse Weather Removal**
*Yijun Yang, Hongtao Wu, Angelica I. Aviles-Rivero, Yulun Zhang, Jing Qin, Lei Zhu*
[[paper]](https://arxiv.org/abs/2403.07684) [[code]](https://github.com/scott-yjyang/DiffTTA)
## Misc
- `[2022 Arxiv]` **Relationship Quantification of Image Degradations**
*Wenxin Wang, Boyun Li, Yuanbiao Gou, Peng Hu, Xi Peng*
[[paper]](https://arxiv.org/abs/2212.04148)