https://github.com/kmedian/keras-layernorm-rnn

RNNs with layer normalization; Prep package for tensorflow/addons, see v0.8.2, and commit https://github.com/tensorflow/addons/commit/cdb43ffd7e4b89d6ce8cdadcd62fec46c7f0f7fa
https://github.com/kmedian/keras-layernorm-rnn

keras layer-normalization recurrent-neural-network rnn rnn-keras rnn-tensorflow simplernn tensorflow

Last synced: 28 days ago
JSON representation

RNNs with layer normalization; Prep package for tensorflow/addons, see v0.8.2, and commit https://github.com/tensorflow/addons/commit/cdb43ffd7e4b89d6ce8cdadcd62fec46c7f0f7fa

• Host: GitHub
• URL: https://github.com/kmedian/keras-layernorm-rnn
• Owner: kmedian
• License: mit
• Created: 2020-01-15T07:51:48.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2023-03-25T00:35:27.000Z (almost 2 years ago)
• Last Synced: 2024-12-15T13:41:18.953Z (about 2 months ago)
• Topics: keras, layer-normalization, recurrent-neural-network, rnn, rnn-keras, rnn-tensorflow, simplernn, tensorflow
• Language: Python
• Homepage:
• Size: 493 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGES.md
  • License: LICENSE

Awesome Lists containing this project

README

        
[![Binder](https://mybinder.org/badge.svg)](https://mybinder.org/v2/gh/kmedian/keras-layernorm-rnn/master?urlpath=lab)

[![Gitpod - Code Now](https://img.shields.io/badge/Gitpod-code%20now-blue.svg?longCache=true)](https://gitpod.io#https://github.com/kmedian/keras-layernorm-rnn)

# keras-layernorm-rnn

## Table of Contents

* [Installation](#installation)

* [Usage](#usage)

* [Commands](#commands)

* [Support](#support)

* [Contributing](#contributing)

## Installation

The `keras-layernorm-rnn` [git repo](http://github.com/kmedian/keras-layernorm-rnn) is available as [PyPi package](https://pypi.org/project/keras-layernorm-rnn)

```

pip install keras-layernorm-rnn

pip install git+ssh://[email protected]/kmedian/keras-layernorm-rnn.git

```

## Usage

Check the [examples](https://github.com/kmedian/keras-layernorm-rnn/blob/master/examples/How%20to%20use%20LayernormSimpleRNN.ipynb) folder for notebooks.

```

import tensorflow as tf

from keras_layernorm_rnn import LayernormLSTM3

model = tf.keras.Sequential([

    LayernormLSTM3(units=8, return_sequences=False),  # Many-to-One

    tf.keras.layers.Dense(1, activation='linear')

])

```

## Commands

Install a virtual environment

```

python3 -m venv .venv

source .venv/bin/activate

pip3 install --upgrade pip

pip3 install -r requirements.txt

```

(If your git repo is stored in a folder with whitespaces, then don't use the subfolder `.venv`. Use an absolute path without whitespaces.)

Python commands

* Jupyter for the examples: `jupyter lab`

* Check syntax: `flake8 --ignore=F401 --exclude=$(grep -v '^#' .gitignore | xargs | sed -e 's/ /,/g')`

* Run Unit Test: `python keras_layernorm_rnn/layernorm_simplernn_test.py`

* Upload to PyPi with twine: `python setup.py sdist && twine upload -r pypi dist/*`

Clean up 

```

find . -type f -name "*.pyc" | xargs rm

find . -type d -name "__pycache__" | xargs rm -r

rm -r .pytest_cache

rm -r .venv

```

## Support

Please [open an issue](https://github.com/kmedian/keras-layernorm-rnn/issues/new) for support.

## Contributing

Please contribute using [Github Flow](https://guides.github.com/introduction/flow/). Create a branch, add commits, and [open a pull request](https://github.com/kmedian/keras-layernorm-rnn/compare/).