Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/dblN/stochastic_depth_keras

Keras implementation for "Deep Networks with Stochastic Depth" http://arxiv.org/abs/1603.09382
https://github.com/dblN/stochastic_depth_keras

Last synced: about 1 month ago
JSON representation

Keras implementation for "Deep Networks with Stochastic Depth" http://arxiv.org/abs/1603.09382

Awesome Lists containing this project

README

        

[Deprecated]
No longer maintained
(to catch up with the latest keras/theano/tensorflow but you'll get the idea of how to implement stochastic depth)

# Deep Networks with Stochastic Depth
Keras implementation for "Deep Networks with Stochastic Depth" http://arxiv.org/abs/1603.09382

Original code(in lua/torch) is at https://github.com/yueatsprograms/Stochastic_Depth.

## Usage

1. Install [Theano](https://github.com/Theano/Theano) following its instruction.
2. Install [Keras](https://github.com/fchollet/keras) (I use new API at `keras-1` branch)

```
$ cd keras
$ git checkout keras-1
$ python setup.py install
```

3. Just run `python train.py`

## Known Issues

- Error related to maximum recursion depth
- When the network is deep, there happens error saying it reaches to maximum recursion depth.
- You can resolve this issue by using `sys.setrecursionlimit(max_recursion_depth)`. You should increase `max_recursion_depth` until you get no error (Increasing this value might cause segmentation fault if you don't have enough memory).

## Results
CIFAR10

- Number of layers == 50
- (other configs are same as `train.py`)

![results](https://cloud.githubusercontent.com/assets/10726958/14477064/904b573e-0146-11e6-865d-99fbd060486e.png)