Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jaykef/gpt-practice
My hands-on learning experience with transformers (GPTs)
https://github.com/jaykef/gpt-practice
Last synced: 7 days ago
JSON representation
My hands-on learning experience with transformers (GPTs)
- Host: GitHub
- URL: https://github.com/jaykef/gpt-practice
- Owner: Jaykef
- Created: 2023-04-18T07:54:30.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-04-27T08:51:23.000Z (6 months ago)
- Last Synced: 2024-04-27T09:44:01.072Z (6 months ago)
- Language: Jupyter Notebook
- Homepage:
- Size: 3.07 MB
- Stars: 7
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Transformers-Practice
My hands-on learning experience with transformers (GPTs) - 中文 Readme
## Learning Roadmap
- GPT Basics - definition, code implementation, use guide
- GPT Advance - high level overview, research papers, applications
- The Anotated Transformer - Havard
- Huggingface Transformer - provides APIs and tools to easily download and train state-of-the-art pretrained models
- GPT Apps - real life applications of GPT (e.g ChatGPT, Jarvis)
## References
Readings
-
Attension is All You Need Paper - Google -
The Illustrated Transformer - by Jay Alammar - The Annotated Transformer - Harvard NLP
- Techniques for training large neural networks - Open AI
- Huggingface Transformer
- The State of GPT - Andrej Karpathy
- CS231n Convolutional Neural Networks for Visual Recognition - Stanford
- Intro to Deep Learning - MIT
- Layer Normalization - Google
- Intro To Natural Language Processing - Transformers
- Matrix multiplication - Wikepedia
Repos
-
nanoGPT - by Andrej Karpathy
-
The Annotated Transformer - Harvard - Tensor2Tensor - Tensorflow implementation of the transformer
## License
MIT License