An open API service indexing awesome lists of open source software.

https://github.com/choidae1/transfomer-pytorch

Implementing Transfomer by PyTorch (in Colab)
https://github.com/choidae1/transfomer-pytorch

pytorch transfomer

Last synced: 2 months ago
JSON representation

Implementing Transfomer by PyTorch (in Colab)

Awesome Lists containing this project

README

        

# Transfomer-PyTorch
Implementing **Transfomer(NIPS 2017)** by PyTorch(in colab) and applying to Translation task. ->
[Code reference site](https://github.com/ndb796/Deep-Learning-Paper-Review-and-Practice/blob/master/code_practices/Attention_is_All_You_Need_Tutorial_(German_English).ipynb)

- Dataset: Multi30k
- Task: Translation (German -> English)
- Model: Transfomer
- Code: [link](https://github.com/ChoiDae1/Transfomer-PyTorch/blob/main/Implementing_Transfomer.ipynb)
- Paper: [link](https://arxiv.org/abs/1706.03762)
- Paper Review: [link](https://science886.tistory.com/21)