https://github.com/thisisiron/transformer-tf2
🤖 Transformer implemented as Tensorflow 2.0
https://github.com/thisisiron/transformer-tf2
attention attention-is-all-you-need natural-language-processing nlp self-attention tensorflow tensorflow2 tf2 transformer translation
Last synced: about 1 month ago
JSON representation
🤖 Transformer implemented as Tensorflow 2.0
- Host: GitHub
- URL: https://github.com/thisisiron/transformer-tf2
- Owner: thisisiron
- License: mit
- Created: 2019-05-02T00:20:36.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2019-10-07T14:27:50.000Z (over 5 years ago)
- Last Synced: 2025-03-28T11:43:19.584Z (about 2 months ago)
- Topics: attention, attention-is-all-you-need, natural-language-processing, nlp, self-attention, tensorflow, tensorflow2, tf2, transformer, translation
- Language: Python
- Homepage:
- Size: 38.1 KB
- Stars: 13
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# transformer-tf2
## Requirements
Tensorflow == 2.0
## Data
WMT'14 English-German data: https://nlp.stanford.edu/projects/nmt/
Download the datasets using the following script:
```
./download.sh
```
## Results
| | Train Set | Validation Set | Test Set |
|---------|--------------|-------------------|----------|
| Model | --% | --% | --% |
## Reference
[Attention Is All You Need](https://arxiv.org/abs/1706.03762)