https://github.com/toy-gpt/train-300-context-2

Demonstrates, at very small scale, how a language model is trained (two-context model).

computer-science-education dual-context educational inspectable-models language-model machine-learning-education mkdocs next-token-prediction probabilistic-model pyright python reproducibility softmax-regression src-layout teaching toy-gpt toy-model two-context-model uv

Last synced: 03 Apr 2026