Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://yuyangyin.github.io/CLEDiffusion/
(MM2023)CLE Diffusion: Controllable Light Enhancement Diffusion Model. Authors: Yuyang Yin, Dejia Xu, Chuangchuang Tan, Ping Liu, Yao Zhao, Yunchao Wei
https://yuyangyin.github.io/CLEDiffusion/
Last synced: about 1 month ago
JSON representation
(MM2023)CLE Diffusion: Controllable Light Enhancement Diffusion Model. Authors: Yuyang Yin, Dejia Xu, Chuangchuang Tan, Ping Liu, Yao Zhao, Yunchao Wei
- Host: GitHub
- URL: https://yuyangyin.github.io/CLEDiffusion/
- Owner: YuyangYin
- Created: 2023-08-03T16:00:13.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-01-23T14:47:33.000Z (12 months ago)
- Last Synced: 2024-01-24T14:51:10.457Z (12 months ago)
- Language: Python
- Homepage: https://yuyangyin.github.io/CLEDiffusion/
- Size: 66.7 MB
- Stars: 39
- Watchers: 2
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- Awesome-Segment-Anything - [code
README
# **(MM2023)CLE Diffusion: Controllable Light Enhancement Diffusion Model**
Authors: Yuyang Yin, Dejia Xu, Chuangchuang Tan, Ping Liu, Yao Zhao, Yunchao Wei
Institutions: Beijing Jiaotong University, UT Austin, A*Star
# Paper Link:
[[2308.06725\] CLE Diffusion: Controllable Light Enhancement Diffusion Model (arxiv.org)](https://arxiv.org/abs/2308.06725)
Project Page：
[CLE Diffusion: Controllable Light Enhancement Diffusion Model(ACM MM 2023) (yuyangyin.github.io)](https://yuyangyin.github.io/CLEDiffusion/)
# Data
Download LOL dataset from [LOL](https://daooshee.github.io/BMVC2018website/). Put the dataset under '/data/LOL' file.
The code also supports other dataset.
# Checkpoint
Download [Pretrianed model](https://drive.google.com/file/d/1uf8Sj1LUduWs6TALM77wxapMAmoGIaEY/view?usp=sharing) on LOL dataset and put it under 'ckpt' file.
Download [Mask CLE Diffusion Pretrianed model](https://drive.google.com/file/d/1VZT3iWgBy_TXA3ASUf_M9_JdfYD4PGlI/view?usp=sharing) and put it under 'ckpt' file.
# Setup
```python
pip install -r requirements.txt
```
# Usage
Our diffusion code structure is based on the original implementation of DDPM. Increasing the size of the U-Net may lead to better results.
About training iteration. The training with 5000 iterations has converged quite well. We recommend training for 10,000 iterations to achieve better performance, and you can select the best-performing training iterations.
We test code on one RTX 3090 GPU. The training time is about 1-2 days.
```python
python train.py #train from scratch, you can change setting in modelConfig
python train.py --pretrained_path ckpt/lol.pt
python test.py --pretrained_path ckpt/lol.pt
```
# Mask CLE Diffusion
Mask CLE Diffusion finetunes lol checkpoint. In our experiments, lol checkpoint is better than mit-adobe-5K checkpoint.
We show some inference cases in 'data/Mask_CLE_cases'. Welcome to use your cases to test the performance.
```python
python mask_generation.py #generate masks for training
python train_mask.py --pretrained_path ckpt/lol.pt #finetune Mask CLE Diffusion
python test_mask.py --pretrained_path ckpt/Mask_CLE.pt --input_path data/Mask_CLE_cases/opera.png --mask_path data/Mask_CLE_cases/opera_mask.png --data_name opera
```
# To Do List
- [x] LOL dataset outputs
- [x] release training and testing code
- [x] release Mask CLE Diffusion code
- [ ] release mit-5k training code and checkpoints
- [ ] update lpips and LI-lpips metrics
# Acknowledgement
This work is mainly built on [DenoisingDiffusionProbabilityModel-ddpm](https://github.com/zoubohao/DenoisingDiffusionProbabilityModel-ddpm-). Thanks a lot to authors for sharing!
# Citation
```
@inproceedings{yin2023cle,
title={CLE Diffusion: Controllable Light Enhancement Diffusion Model},
author={Yin, Yuyang and Xu, Dejia and Tan, Chuangchuang and Liu, Ping and Zhao, Yao and Wei, Yunchao},
booktitle={Proceedings of the 31st ACM International Conference on Multimedia},
pages={8145--8156},
year={2023}
}
```
If you have any problems, please feel free to create a new issue or email me([email protected])..