https://github.com/wohlert/semi-supervised-pytorch

Implementations of various VAE-based semi-supervised and generative models in PyTorch
https://github.com/wohlert/semi-supervised-pytorch

generative-models pytorch semi-supervised-learning

Last synced: 2 months ago
JSON representation

Implementations of various VAE-based semi-supervised and generative models in PyTorch

• Host: GitHub
• URL: https://github.com/wohlert/semi-supervised-pytorch
• Owner: wohlert
• License: mit
• Created: 2017-09-28T09:41:18.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2020-03-02T14:23:59.000Z (over 4 years ago)
• Last Synced: 2024-01-26T18:36:11.855Z (5 months ago)
• Topics: generative-models, pytorch, semi-supervised-learning
• Language: Python
• Homepage:
• Size: 12.5 MB
• Stars: 696
• Watchers: 16
• Forks: 124
• Open Issues: 6
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.md

Lists

• Awesome-pytorch-list - semi-supervised-pytorch - based semi-supervised and generative models in PyTorch. (Pytorch & related libraries / Other libraries:)
• Awesome-pytorch-list-CNVersion - semi-supervised-pytorch

README

        
# Semi-supervised PyTorch

A PyTorch-based package containing useful models for modern deep semi-supervised learning and deep generative models. Want to jump right into it? Look into the [notebooks](examples/notebooks).

### Latest additions

*2018.04.17* - The Gumbel softmax notebook has been added to show how

you can use discrete latent variables in VAEs.

*2018.02.28* - The β-VAE notebook was added to show how VAEs can learn disentangled representations.

## What is semi-supervised learning?

Semi-supervised learning tries to bridge the gap between supervised and unsupervised learning by learning from both

labelled and unlabelled data.

Semi-supervised learning can typically be applied to areas where data is easy to get a hold of, but labelling is expensive.

Normally, one would either use an unsupervised method, or just the few labelled examples - both of which would be

likely to yield bad results.

The current state-of-the-art method in semi-supervised learning achieves an accuracy of over 99% on the MNIST dataset using just **10 labelled examples per class**.

## Conditional generation

Most semi-supervised models simultaneously train an inference network and a generator network. This means that it is

not only possible to query this models for classification, but also to generate new data from trained model.

By seperating label information, one can generate a new sample with the given digit as shown in the image below from

Kingma 2014.

![Conditional generation of samples](examples/images/conditional.png)

## Implemented models and methods:

* [Variational Autoencoder (Kingma 2013)](https://arxiv.org/abs/1312.6114)

* [Importance Weighted Autoencoders (Burda 2015)](https://arxiv.org/abs/1509.00519)

* [Variational Inference with Normalizing Flows (Rezende & Mohamed 2015)](https://arxiv.org/abs/1505.05770)

* [Semi-supervised Learning with Deep Generative Models (Kingma 2014)](https://arxiv.org/abs/1406.5298)

* [Auxiliary Deep Generative Models (Maaløe 2016)](https://arxiv.org/abs/1602.05473)

* [Ladder Variational Autoencoders (Sønderby 2016)](https://arxiv.org/abs/1602.02282)

* [β-VAE (Higgins 2017)](https://openreview.net/forum?id=Sy2fzU9gl)