https://github.com/ggldnl/transformer
Pytorch lightning implementation of the original Transformer architecture
https://github.com/ggldnl/transformer
machine-translation transformer
Last synced: 3 months ago
JSON representation
Pytorch lightning implementation of the original Transformer architecture
- Host: GitHub
- URL: https://github.com/ggldnl/transformer
- Owner: ggldnl
- Created: 2024-02-08T11:09:55.000Z (over 1 year ago)
- Default Branch: master
- Last Pushed: 2024-03-31T18:21:21.000Z (about 1 year ago)
- Last Synced: 2025-01-14T02:47:39.559Z (5 months ago)
- Topics: machine-translation, transformer
- Language: Python
- Homepage:
- Size: 101 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Transformer
Pytorch lightning implementation of the original Transformer architecture
as described in the [Attention Is All You Need](https://arxiv.org/abs/1706.03762) paper.
Along with the architecture, the repo contains the code to run training and inference on
a machine translation task to translate from english to italian. A Tokenizer and a Dataloader are provided as well.
The dataloader uses the [OPUS Books](https://huggingface.co/datasets/opus_books) dataset.