https://github.com/anto18671/lumenspark

Lumenspark is a lightweight Linformer-based Language Model Trained from Scratch

layer-scale linformer llm low-rank-approximation prenormalization pretraining runpod text-classification text-generation training transformer

Last synced: 04 Jul 2026