https://github.com/X1716/IQA-Adapter

Code for the paper "IQA-Adapter: Exploring Knowledge Transfer from Image Quality Assessment to Diffusion-based Generative Models"
https://github.com/X1716/IQA-Adapter

adapter diffusion-models image-generation image-quality-assessment

Last synced: about 2 months ago
JSON representation

Code for the paper "IQA-Adapter: Exploring Knowledge Transfer from Image Quality Assessment to Diffusion-based Generative Models"

• Host: GitHub
• URL: https://github.com/X1716/IQA-Adapter
• Owner: X1716
• Created: 2024-11-27T12:14:38.000Z (about 2 months ago)
• Default Branch: main
• Last Pushed: 2024-12-04T12:42:22.000Z (about 2 months ago)
• Last Synced: 2024-12-04T13:40:09.437Z (about 2 months ago)
• Topics: adapter, diffusion-models, image-generation, image-quality-assessment
• Homepage:
• Size: 5.63 MB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-diffusion-categorized - [Code

README

        
# ___***IQA-Adapter***___

[![arXiv](https://img.shields.io/badge/arXiv-2412.01794-b31b1b.svg)](https://arxiv.org/abs/2412.01794)

Code for the paper "IQA-Adapter: Exploring Knowledge Transfer from Image Quality Assessment to Diffusion-based Generative Models"

*TLDR*: IQA-Adapter is a tool that combines Image Quality/Aesthetics Assessment (IQA/IAA) models with image-generation and enables quality-aware generation with diffusion-based models. It allows to condition image generators on target quality/aesthetics scores.

IQA-Adapter is based on [IP-Adapter](https://github.com/tencent-ailab/IP-Adapter) architecture.

TODO list:

- [ ] Release code for IQA-Adapter inference and training for SDXL base model

- [ ] Release weights for IQA-Adapters trained with different IQA/IAA models

- [ ] Create project page

- [ ] Release code for experiments

Demonstration of guidance on quality (y-axis) and aesthetics (x-axis) scores:

![demo image](/assets/2d_viz.png)

## Citation

If you find this work useful for your research, please cite us as follows:

```bibtex

@misc{iqaadapter,

      title={IQA-Adapter: Exploring Knowledge Transfer from Image Quality Assessment to Diffusion-based Generative Models}, 

      author={Khaled Abud and Sergey Lavrushkin and Alexey Kirillov and Dmitriy Vatolin},

      year={2024},

      eprint={2412.01794},

      archivePrefix={arXiv},

      primaryClass={cs.CV},

      url={https://arxiv.org/abs/2412.01794}, 

}

```