https://github.com/choidae1/transfomer-pytorch
Implementing Transfomer by PyTorch (in Colab)
https://github.com/choidae1/transfomer-pytorch
pytorch transfomer
Last synced: 2 months ago
JSON representation
Implementing Transfomer by PyTorch (in Colab)
- Host: GitHub
- URL: https://github.com/choidae1/transfomer-pytorch
- Owner: ChoiDae1
- Created: 2022-02-21T13:35:12.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2022-02-23T14:08:21.000Z (about 3 years ago)
- Last Synced: 2025-01-17T12:17:28.529Z (4 months ago)
- Topics: pytorch, transfomer
- Language: Jupyter Notebook
- Homepage:
- Size: 636 KB
- Stars: 4
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Transfomer-PyTorch
Implementing **Transfomer(NIPS 2017)** by PyTorch(in colab) and applying to Translation task. ->
[Code reference site](https://github.com/ndb796/Deep-Learning-Paper-Review-and-Practice/blob/master/code_practices/Attention_is_All_You_Need_Tutorial_(German_English).ipynb)- Dataset: Multi30k
- Task: Translation (German -> English)
- Model: Transfomer
- Code: [link](https://github.com/ChoiDae1/Transfomer-PyTorch/blob/main/Implementing_Transfomer.ipynb)
- Paper: [link](https://arxiv.org/abs/1706.03762)
- Paper Review: [link](https://science886.tistory.com/21)