Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jalalilabucla/jalali-lab-implementation-of-raisr
Implementation of RAISR (Rapid and Accurate Image Super Resolution) algorithm in Python 3.x by Jalali Laboratory at UCLA. The implementation presented here achieved performance results that are comparable to that presented in Google's research paper (with less than ± 0.1 dB in PSNR). Just-in-time (JIT) compilation employing JIT numba is used to speed up the Python code. A very parallelized Python code employing multi-processing capabilities is used to speed up the testing process. The code has been tested on GNU/Linux and Mac OS X 10.13.2 platforms.
https://github.com/jalalilabucla/jalali-lab-implementation-of-raisr
image-processing just-in-time phase-stretch-transform pst python raisr super-resolution
Last synced: 21 days ago
JSON representation
Implementation of RAISR (Rapid and Accurate Image Super Resolution) algorithm in Python 3.x by Jalali Laboratory at UCLA. The implementation presented here achieved performance results that are comparable to that presented in Google's research paper (with less than ± 0.1 dB in PSNR). Just-in-time (JIT) compilation employing JIT numba is used to speed up the Python code. A very parallelized Python code employing multi-processing capabilities is used to speed up the testing process. The code has been tested on GNU/Linux and Mac OS X 10.13.2 platforms.
- Host: GitHub
- URL: https://github.com/jalalilabucla/jalali-lab-implementation-of-raisr
- Owner: JalaliLabUCLA
- License: gpl-3.0
- Created: 2018-07-29T08:32:23.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2022-11-22T02:20:43.000Z (about 2 years ago)
- Last Synced: 2023-11-07T18:12:27.646Z (about 1 year ago)
- Topics: image-processing, just-in-time, phase-stretch-transform, pst, python, raisr, super-resolution
- Language: Python
- Homepage:
- Size: 27.5 MB
- Stars: 126
- Watchers: 7
- Forks: 47
- Open Issues: 8
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Jalali-Lab Implementation of RAISR Algorithm
## Contents
1. [Introduction](#introduction)
2. [Dependencies](#dependencies)
3. [Training](#training)
4. [Testing](#testing)
5. [Quantitative Comparison](#quantitative-comparison)
6. [Sample Result](#sample-result)
7. [Citations](#citations)
8. [Acknowledgments](#acknowledgments)
9. [License](#license)
## Introduction
[RAISR](http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=7744595) (Rapid and Accurate Image Super Resolution) is an image processing algorithm published by Google Research in 2016. With sufficient training data, consisting of low and high resolution image pairs, RAISR algorithm tries to learn a set of filters which can be applied to an input image that is not in the training set, to produce a higher resolution version of it. The source code released here is the [Jalali-Lab](http://photonics.ucla.edu/index.html) implementation of the RAISR algorithm written in Python 3.x by [Sifeng He](https://www.linkedin.com/in/sifeng-he-969230134/), under the guidance of [Prof. Bahram Jalali](http://photonics.ucla.edu/bahram_jalali.html). The implementation presented here achieved performance results that are comparable to that presented in Google's research paper (with less than ± 0.1 dB in PSNR).
Just-in-time (JIT) compilation employing JIT numba is used to speed up the Python code. A very parallelized Python code employing multi-processing capabilities is used to speed up the testing process. The code has been tested on **GNU/Linux** and **Mac OS X 10.13.2** platforms.
## Dependencies
All the dependent Python modules needed for the using our RAISR implementation can be installed using pip package manager and are the following:
* NumPy
* Numba
* Python Imaging Library (PIL)
* scipy
* os
* pickle
* skimage
Additionally, a requirements.txt file is provided for installing all the dependencies by running the following command in a shell:
```
pip install -U -r requirements.txt
```
## Training
All the training images are to be stored in the **trainingData** directory, before executing the **Train.py** script. In the training script, modify the upscaling factor, R, appropriately. The training outputs three files, **filter**, **Qfactor_str**, and **Qfactor_coh**, which are needed in the testing phase. The training data used in this implementation is the **BSD 200** ([Martin et al. ICCV 2001](https://www.eecs.berkeley.edu/Research/Projects/CS/vision/bsds/)). A pre-trained filter with upscaling factors x2, x3, and x4 are available for testing in the **Filter** directory. To execute training, simply run the following command in your shell:
```
python Train.py
```
## Testing
All the test images are to be stored in the **testData** directory, before executing the **Test.py** script. In the test script, change the upscaling factor, R, and filters. The result image will be saved in **results** directory. The test data used for the development of the algorithm were **Set 5** ([Bevilacqua et al. BMVC 2012](http://people.rennes.inria.fr/Aline.Roumy/results/SR_BMVC12.html)) and **Set 14** ([Zeyde et al. LNCS 2010](https://sites.google.com/site/romanzeyde/research-interests)). To execute testing, simply run the following command in your shell:
```
python Test.py
```
## Quantitative Comparison
| Upscale Factor | Google RAISR | Our implementation trained
on BSD 200 images | Our implementation trained
on COCO (500 images) |
|:-------------: |:---------------:| :-------------:| :-------------:|
| 2x | 35.913 | 35.855| 35.878 |
| 3x | 32.061 | 31.981| 32.019 |
| 4x | 29.689 | 29.717| 29.801 |
##### Table 1. Comparison of Results on [Set 5](http://people.rennes.inria.fr/Aline.Roumy/results/SR_BMVC12.html) Images
| Upscale Factor | Google RAISR | Our implementation trained
on BSD 200 images | Our implementation trained
on COCO (500 images) |
|:-------------: |:---------------:| :-------------:| :-------------:|
| 2x | 31.980 | 31.790| 31.816 |
| 3x | 28.764 | 31.714| 28.729 |
| 4x | 26.912 | 26.901| 26.935 |
##### Table 2. Comparison of Results Results on [Set 14](https://sites.google.com/site/romanzeyde/research-interests) Images
Google's RAISR implementation was trained on 10000 advertising banner images. Our implementation of RAISR was trained on [BSD 200](https://www.eecs.berkeley.edu/Research/Projects/CS/vision/bsds/) (200 images) and on 500 images from [COCO](http://mscoco.org/) dataset. The training time for our implementation on a 3.4 GHz 6-core Xeon desktop computer is about 20 minutes for BSD 200 dataset and an hour for the 500 images from COCO dataset. The average test time for one single image in test dataset ([Set 5](http://people.rennes.inria.fr/Aline.Roumy/results/SR_BMVC12.html) and [Set 14](https://sites.google.com/site/romanzeyde/research-interests)) is less than 1 second.
## Sample Result
A high resolution image after downscaling it by 2 was used as the input low resolution image to both bicubic interpolation and our implementation of RAISR algorithm. A comparison of the resulted output image for this testcase with bicubic interpolation and our implementation of RAISR is shown in the figure above.
## Citations
Please cite the following publications if you plan to use the code or the results for your research:
1. Sifeng He, Bahram Jalali. "Brain MRI Image Super Resolution using Phase Stretch Transform and Transfer Learning", *arXiv preprint arXiv:1807.11643*, (2018). [URL](https://arxiv.org/abs/1807.11643)
Bibtex:
```
@article{he2018brain,
title={Brain MRI Image Super Resolution using Phase Stretch Transform and Transfer Learning},
author={He, Sifeng and Jalali, Bahram},
journal={arXiv preprint arXiv:1807.11643},
year={2018}
}
```
## Acknowledgments
Special thanks to [Dr. Cejo Konuparamban Lonappan](https://www.linkedin.com/in/cejokl/) for his support and guidance.
## License
The code is released under GNU General Public License 3.0. Please refer to the LICENSE file for details.