https://github.com/mayankbohra/transformer-using-pytorch
Built the transformer model from paper ‘Attention is all you need’ from scratch using PyTorch library.
https://github.com/mayankbohra/transformer-using-pytorch
encoder-decoder large-language-models nlp-machine-learning transformers
Last synced: over 1 year ago
JSON representation
Built the transformer model from paper ‘Attention is all you need’ from scratch using PyTorch library.
- Host: GitHub
- URL: https://github.com/mayankbohra/transformer-using-pytorch
- Owner: mayankbohra
- Created: 2024-04-10T10:50:03.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-04-10T10:54:56.000Z (about 2 years ago)
- Last Synced: 2025-01-05T22:12:33.893Z (over 1 year ago)
- Topics: encoder-decoder, large-language-models, nlp-machine-learning, transformers
- Language: Python
- Homepage:
- Size: 5.86 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Transformer-using-PyTorch
Built the transformer model from paper ‘Attention is all you need’ from scratch using PyTorch library.
To understand the code in-depth, you can refer my blog post on [Build your own Transformer Model from Scratch using Pytorch](https://mayankblogs.hashnode.dev/build-your-own-transformer-model-from-scratch-using-pytorch)