https://github.com/ikostrikov/pytorch-meta-optimizer

A PyTorch implementation of Learning to learn by gradient descent by gradient descent
https://github.com/ikostrikov/pytorch-meta-optimizer

deep-learning gradient-descent pytorch

Last synced: 2 days ago
JSON representation

A PyTorch implementation of Learning to learn by gradient descent by gradient descent

• Host: GitHub
• URL: https://github.com/ikostrikov/pytorch-meta-optimizer
• Owner: ikostrikov
• License: mit
• Created: 2017-01-30T05:26:28.000Z (almost 8 years ago)
• Default Branch: master
• Last Pushed: 2018-08-27T09:04:29.000Z (about 6 years ago)
• Last Synced: 2024-04-20T11:30:38.950Z (7 months ago)
• Topics: deep-learning, gradient-descent, pytorch
• Language: Python
• Size: 17.6 KB
• Stars: 308
• Watchers: 16
• Forks: 56
• Open Issues: 6
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.md

Awesome Lists containing this project

README

        
# Intro

PyTorch implementation of [Learning to learn by gradient descent by gradient descent](https://arxiv.org/abs/1606.04474).

## Run

```bash

python main.py

```

### TODO

- [x] Initial implementation

- [x] Toy data

- [x] LSTM updates

- [ ] Refactor, find a better way to organize the modules

- [ ] Compare with standard optimizers

- [x] Real data

- [ ] More difficult models