https://github.com/tensorboy/pidoptimizer
Code for this CVPR 2018 paper: "A PID Controller Approach for Stochastic Optimization of Deep Networks", Wangpeng An, Haoqian Wang, Qingyun Sun, Jun Xu, Qionghai Dai, Lei Zhang.
https://github.com/tensorboy/pidoptimizer
Last synced: 7 months ago
JSON representation
Code for this CVPR 2018 paper: "A PID Controller Approach for Stochastic Optimization of Deep Networks", Wangpeng An, Haoqian Wang, Qingyun Sun, Jun Xu, Qionghai Dai, Lei Zhang.
- Host: GitHub
- URL: https://github.com/tensorboy/pidoptimizer
- Owner: tensorboy
- Created: 2018-03-09T21:26:53.000Z (almost 8 years ago)
- Default Branch: master
- Last Pushed: 2019-05-09T02:38:46.000Z (almost 7 years ago)
- Last Synced: 2024-12-15T11:53:12.037Z (about 1 year ago)
- Language: Python
- Homepage:
- Size: 11.6 MB
- Stars: 185
- Watchers: 15
- Forks: 54
- Open Issues: 8
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# PIDOptimizer (Proportional–Integral–Derivative Optimizer)
This repository contains source code of the CVPR 2018 paper:
* [*A PID Controller Approach for Stochastic Optimization of Deep Networks*](http://www4.comp.polyu.edu.hk/~cslzhang/paper/CVPR18_PID.pdf), Wangpeng An, Haoqian Wang, Qingyun Sun, Jun Xu, Qionghai Dai, Lei Zhang.
## Prerequisite:
* matplotlib==2.0.2
## Train MLP on MNIST DATAST
`python mnist_pid.py`
`python mnist_momentum.py`
`python compare.py`
PID Vs. SGD-Momentum
## Citation:
If PIDOptimizer is used in your paper/experiments, please cite the following paper.
```
@InProceedings{An_2018_CVPR,
author = {An, Wangpeng and Wang, Haoqian and Sun, Qingyun and Xu, Jun and Dai, Qionghai and Zhang, Lei},
title = {A PID Controller Approach for Stochastic Optimization of Deep Networks},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2018}
}
```