https://github.com/xl0/transformers

Playing with transformers from scratch
https://github.com/xl0/transformers

Last synced: 17 days ago
JSON representation

Playing with transformers from scratch

• Host: GitHub
• URL: https://github.com/xl0/transformers
• Owner: xl0
• Created: 2023-09-20T16:40:51.000Z (over 1 year ago)
• Default Branch: master
• Last Pushed: 2023-10-02T11:09:22.000Z (over 1 year ago)
• Last Synced: 2024-10-30T08:26:02.590Z (2 months ago)
• Language: Jupyter Notebook
• Size: 1.2 MB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
### 22/09/2023

- [x] Share VSCode

- [x] Clean up the code.

- [x] W&B refresher

- [x] Dataset code, pick dataset, loader, etc.

- [x] Train bigram model

### 23/09/2023

- [x] Clean up Bigram model

- [ ] Minimal transformer

### 30/09/2023

- [x] Generator function

- [ ] Minimal transformer