Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/satoshiiizuka/siggraph2016_colorization
Code for the paper 'Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification'.
https://github.com/satoshiiizuka/siggraph2016_colorization
Last synced: 13 days ago
JSON representation
Code for the paper 'Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification'.
- Host: GitHub
- URL: https://github.com/satoshiiizuka/siggraph2016_colorization
- Owner: satoshiiizuka
- License: other
- Created: 2016-04-20T05:20:50.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2022-06-13T02:05:02.000Z (over 2 years ago)
- Last Synced: 2024-07-31T23:46:03.065Z (3 months ago)
- Language: Lua
- Homepage: http://hi.cs.waseda.ac.jp/~iizuka/projects/colorization/
- Size: 1.48 MB
- Stars: 2,167
- Watchers: 112
- Forks: 302
- Open Issues: 13
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-github-star - siggraph2016_colorization - to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification'. | satoshiiizuka | 2170 | (Lua)
README
# [Let there be Color!: Automatic Colorization of Grayscale Images](http://hi.cs.waseda.ac.jp/~iizuka/projects/colorization/)
[Satoshi Iizuka](http://hi.cs.waseda.ac.jp/~iizuka/index_eng.html)\*, [Edgar Simo-Serra](http://hi.cs.waseda.ac.jp/~esimo/)\*, [Hiroshi Ishikawa](http://www.f.waseda.jp/hfs/indexE.html) (\* equal contribution)
## Overview
This code provides an implementation of the research paper:
```
"Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification"
Satoshi Iizuka, Edgar Simo-Serra, and Hiroshi Ishikawa
ACM Transaction on Graphics (Proc. of SIGGRAPH 2016), 2016
```
We learn to automatically color grayscale images with a deep network. Our
network learns both local features and global features jointly in a single
framework. Our approach can then be used on images of any resolution. By
incorporating global features we are able to obtain realistic colorings with
our model.
See our [project page](http://hi.cs.waseda.ac.jp/~iizuka/projects/colorization/) for more detailed information.
## License
```
Copyright (C) <2016>
This work is licensed under the Creative Commons
Attribution-NonCommercial-ShareAlike 4.0 International License. To view a copy
of this license, visit http://creativecommons.org/licenses/by-nc-sa/4.0/ or
send a letter to Creative Commons, PO Box 1866, Mountain View, CA 94042, USA.
Satoshi Iizuka, Waseda University
[email protected], http://hi.cs.waseda.ac.jp/~iizuka/index_eng.html
Edgar Simo-Serra, Waseda University
[email protected], http://hi.cs.waseda.ac.jp/~esimo/
```
## Dependencies
- [Torch7](http://torch.ch/docs/getting-started.html)
- [nn](https://github.com/torch/nn)
- [image](https://github.com/torch/image)
- [nngraph](https://github.com/torch/nngraph)
All packages should be part of a standard Torch7 install. For information on how to install Torch7 please see the [official torch documentation](http://torch.ch/docs/getting-started.html) on the subject.
## Usage
First, download the colorization model by running the download script:
```
./download_model.sh
```
Basic usage is:
```
th colorize.lua []
```
For example:
```
th colorize.lua ansel_colorado_1941.png out.png
```
### Best Performance
- This model was trained on the [Places dataset](http://places.csail.mit.edu/) and thus best performance is for natural outdoor images.
- While the model works on any size image, we trained it on 224x224 pixel images and thus it works best on small images. Note that you can process a small imageto obtain the chrominance map and then rescale it and combine it with the original grayscale image for higher quality.
- Larger image sizes can give uneven colorings (limited by spatial support of the network).
### ImageNet Model
We also provide the colorization model that was trained on [ImageNet](http://image-net.org/challenges/LSVRC/2012/index). This model can be used for comparisons with other colorization models trained on ImageNet. We recommend using the places colorization model for general purposes.
For using the ImageNet model, download the model by running:
```
./download_model_imagenet.sh
```
Usage is:
```
th colorize.lua colornet_imagenet.t7
```
### Notes
- This is developed on a linux machine running Ubuntu 14.04 during late 2015.
- The provided code does not use GPU accelerated (trivial to change).
- Please note that the model is slow on large images (over 512x512 pixels) and may run out of memory. Demo should take around 2 GiB of peak RAM memory, system with 4 GiB or more of RAM is recommended.
- Provided model and sample code is under a non-commercial creative commons license.
## Citing
If you use this code please cite:
```
@Article{IizukaSIGGRAPH2016,
author = {Satoshi Iizuka and Edgar Simo-Serra and Hiroshi Ishikawa},
title = {{Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification}},
journal = "ACM Transactions on Graphics (Proc. of SIGGRAPH 2016)",
year = 2016,
volume = 35,
number = 4,
}
```