https://github.com/bojone/attention

some attention implements
https://github.com/bojone/attention

Last synced: 3 months ago
JSON representation

some attention implements

• Host: GitHub
• URL: https://github.com/bojone/attention
• Owner: bojone
• Created: 2018-01-06T05:39:15.000Z (almost 7 years ago)
• Default Branch: master
• Last Pushed: 2019-11-20T10:17:44.000Z (almost 5 years ago)
• Last Synced: 2024-06-24T05:47:26.550Z (5 months ago)
• Language: Python
• Size: 54.7 KB
• Stars: 1,428
• Watchers: 32
• Forks: 512
• Open Issues: 11
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• StarryDivineSky - bojone/attention

README

        
# attention

some attention implements

《Attention is All You Need》中的Attention机制的实现

http://kexue.fm/archives/4765/

## 测试环境

python 2.7 + tensorflow 1.8+ + keras 2.2.4

注：本项目不再跟进新版本的tensorflow/keras，如果有新版本的需求，可以到bert4keras的layers.py处复制对应的函数。

## 交流

QQ交流群：67729435，微信群请加机器人微信号spaces_ac_cn