https://github.com/zimmerrol/show-attend-and-tell-keras

Keras implementation of the "Show, Attend and Tell" paper
https://github.com/zimmerrol/show-attend-and-tell-keras

attention-mechanism image-captioning keras lstm mscoco-image-dataset nlp rnn show-attend-and-tell tensorflow

Last synced: about 2 months ago
JSON representation

Keras implementation of the "Show, Attend and Tell" paper

• Host: GitHub
• URL: https://github.com/zimmerrol/show-attend-and-tell-keras
• Owner: zimmerrol
• License: mit
• Created: 2018-06-28T03:50:12.000Z (about 7 years ago)
• Default Branch: master
• Last Pushed: 2019-04-21T15:08:34.000Z (about 6 years ago)
• Last Synced: 2025-05-01T02:53:31.240Z (about 2 months ago)
• Topics: attention-mechanism, image-captioning, keras, lstm, mscoco-image-dataset, nlp, rnn, show-attend-and-tell, tensorflow
• Language: Python
• Size: 73.2 KB
• Stars: 26
• Watchers: 4
• Forks: 12
• Open Issues: 6
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Show, Attend and Tell (Keras) [WIP]

Keras implementation of the paper [Show, Attend and Tell: Neural Image Caption Generation with Visual Attention](http://arxiv.org/abs/1502.03044) which introduces an attention based image caption generator. The model changes its attention to the relevant part of the image while it generates each word.

This figure form the original paper gives a short explanation of the network's structure.

![Architecture](model.png)

This project depends on the [Keras Utility & Layer Collection (kulc)](https://github.com/FlashTek/keras-layer-collection), which implements many useful layers and utility functions for attention based models.