https://github.com/mkashirin/cattode

Lil GPT and BPE built from scratch using PyTorch.
https://github.com/mkashirin/cattode

bpe deeplearning gpt languagemodels pytorch tokenizers

Last synced: about 2 months ago
JSON representation

Lil GPT and BPE built from scratch using PyTorch.

• Host: GitHub
• URL: https://github.com/mkashirin/cattode
• Owner: mkashirin
• License: mit
• Created: 2025-03-26T14:16:29.000Z (2 months ago)
• Default Branch: main
• Last Pushed: 2025-04-08T18:23:22.000Z (about 2 months ago)
• Last Synced: 2025-04-08T19:35:47.025Z (about 2 months ago)
• Topics: bpe, deeplearning, gpt, languagemodels, pytorch, tokenizers
• Language: Python
• Homepage:
• Size: 3.85 MB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
Cattode


Cattode — Cool Atto-Scale (GPT) Decoder (featuring BPE tokenizer) built from scratch using PyTorch.