https://github.com/ylogx/aesthetics

Image Aesthetics Toolkit - includes Fisher Vector implementation, AVA (Image Aesthetic Visual Analysis) dataset and fast multi-threaded downloader
https://github.com/ylogx/aesthetics

aesthetic aesthetics ava dataset dataset-creation dataset-generation datasets fisher-vectors image image-aesthetic-visual-analysis image-processing live

Last synced: 5 days ago
JSON representation

Image Aesthetics Toolkit - includes Fisher Vector implementation, AVA (Image Aesthetic Visual Analysis) dataset and fast multi-threaded downloader

• Host: GitHub
• URL: https://github.com/ylogx/aesthetics
• Owner: ylogx
• License: apache-2.0
• Created: 2017-03-21T11:50:53.000Z (almost 8 years ago)
• Default Branch: master
• Last Pushed: 2023-07-06T21:12:18.000Z (over 1 year ago)
• Last Synced: 2024-12-09T21:11:59.134Z (13 days ago)
• Topics: aesthetic, aesthetics, ava, dataset, dataset-creation, dataset-generation, datasets, fisher-vectors, image, image-aesthetic-visual-analysis, image-processing, live
• Language: Python
• Homepage:
• Size: 4.17 MB
• Stars: 215
• Watchers: 9
• Forks: 54
• Open Issues: 8
• Metadata Files:
  • Readme: README.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE

Awesome Lists containing this project

• awesome-cv - aesthetics

README

        
# Aesthetics

## Image Aesthetics Definition

Image aesthetic evaluation aims to classify photos into high quality or low quality from the perspective of human.

High Quality Image                    |            Low Quality Image

:------------------------------------:|:-------------------------------------:

![Good Image](https://i.imgur.com/ZGiqssA.png)  |  ![Bad Image](https://i.imgur.com/1do94BE.png)

Image Aesthetics drills down to a classification problem:

* Low Quality Image 

* High Quality Image 

A commonly used dataset for image aesthetics is AVA (Image Aesthetic Visual Analysis) dataset

This repo provides following tools to help in image aesthetics problem:

* [Fisher Vector implementation](https://github.com/shubhamchaudhary/aesthetics/tree/master/aesthetics/fisher)

* AVA dataset and fast multi-threaded downloader

## Fisher Vector

Fisher Vector is a technique for generating features for images, which can be used by discriminative models like SVM. You can use fisher vectors for usecases like image classification (ImageNet), image aesthetics.

### Flow

* We create local descriptors using SIFT for each image in the training set

* We fit a Gausian Mixture Model (GMM) on descriptors for all images in training set.

* Using this global GMM we generate features for each image

![Fisher Vector flow](https://i.imgur.com/S5oAnEU.png)

### Spatial Pooling

Spatial pooling is a technique to save the spatial information of the image while generating features. This is very important in image aesthetics because the look and feel of the image are highly dependent on the aspect ratio, placement of the objects in the image.

Following image should clarify the importance of spatial pooling:

![Importance of spatial pooling](https://i.imgur.com/nZ3aYkL.png)

For spatial pooling, the fisher vector paper recommends splitting the image into 4 patches:

* Full image patch

* 3 horizontal sliced patches of the image

To generate the fisher vector of the image, as shown in the flowchart above, we concat the fisher vectors of the 4 individual patches of the image.

## AVA Downloader

```sh

./download.py --help

./download.py ava

```

This is a WIP