Projects in Awesome Lists by nanowell
A curated list of projects in awesome lists by nanowell .
https://github.com/nanowell/ademamix-optimizer-pytorch
The AdEMAMix Optimizer: Better, Faster, Older.
ademamix artificial-intelligence deep-neural-networks machine-learning multimodal optimizer pytorch
Last synced: 30 Apr 2025
https://github.com/nanowell/q-sparse-llm
My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
artificial-intelligence deep-neural-networks deeplearning large-language-models machine-learning q-sparse sparse-neural-networks transformer
Last synced: 24 Jun 2025
https://github.com/nanowell/differential-transformer-pytorch
PyTorch implementation of the Differential-Transformer architecture for sequence modeling, specifically tailored as a decoder-only model similar to large language models (LLMs). The architecture incorporates a novel Differential Attention mechanism, Multi-Head structure, RMSNorm, and SwiGLU.
differential-transformer large-language-models machine-learning pytorch
Last synced: 31 Jul 2025
https://github.com/nanowell/gpt-cody
GPT Coding automation agent. Artificial Intelligence System that helps you to automate coding. You only provide idea.
Last synced: 15 Oct 2025
https://github.com/nanowell/speech-to-speech-lm
Native Speech to Speech Language Model
Last synced: 27 Mar 2025
https://github.com/nanowell/neural-rendering
Testing AI models to render a 3d scene
Last synced: 07 Jan 2026