https://github.com/urmzd/experimental-transformer-architectures

Can a language model learn algorithms instead of memorizing patterns? Exploring extreme parameter efficiency in vocabulary space — 350K params, no embedding, no output projection, every intermediate state readable as words.

interpretable-ml language-model meta-learning parameter-golf pytorch register-machine reinforcement-learning

Last synced: 04 May 2026