https://github.com/sigmaquan/elwm

External Long-term and Working Memory augmented Recurrent Neural Networks (ELWM).
https://github.com/sigmaquan/elwm

elwm-rnns external-memory recurrent-neural-networks

Last synced: 3 months ago
JSON representation

External Long-term and Working Memory augmented Recurrent Neural Networks (ELWM).

• Host: GitHub
• URL: https://github.com/sigmaquan/elwm
• Owner: SigmaQuan
• License: mit
• Created: 2016-12-21T07:33:15.000Z (over 8 years ago)
• Default Branch: master
• Last Pushed: 2017-02-24T15:19:49.000Z (over 8 years ago)
• Last Synced: 2025-01-21T17:27:26.703Z (5 months ago)
• Topics: elwm-rnns, external-memory, recurrent-neural-networks
• Homepage:
• Size: 65.4 KB
• Stars: 7
• Watchers: 4
• Forks: 3
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# External Long-term and Working Memory augmented Recurrent Neural Networks (ELWM-RNNs)

Experiment on External Long-term and Working Memory augmented Recurrent Neural Networks (ELWM-RNNs).

## Prerequisties

- Python 2.7

- [Theano](https://github.com/Theano/Theano)

- [Keras](https://github.com/fchollet/keras)

## Experiment on algorithm learning

**Copy**

![alt_tag](unit_test/image/figure_4.png)

**Memory Use During the Copy Task**

![alt_tag](unit_test/image/figure_6.png)

**Repeat Copy**

(Coming soon...)

**Associative Recall**

(Coming soon...)

**Priority Sort**

(Coming soon...)

## Experiment on language modeling

**PTB**

(Coming soon...)

**Text8**

(Coming soon...)

**CBT**

(Coming soon...)

## Experiment on question answering 

**bAbI**

(Coming soon...)

## Usage

To train a copy task:

```

    $ python main.py

```

## Future works

- Training ELWM-RNNs with reinforcement learning method.

- Using ELWM-RNNs for other natural language processing tasks.

## Author

Zhibin Quan / [@SigmaQuan](https://github.com/SigmaQuan)