Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists tagged with sub-quadratic-attention

A curated list of projects in awesome lists tagged with sub-quadratic-attention .

https://github.com/shjwudp/megabyte

A PyTorch implementation of MEGABYTE. This multi-scale transformer architecture has the excellent features of tokenization-free and sub-quadratic attention. The paper link: https://arxiv.org/abs/2305.07185

deep-learning language-model sub-quadratic-attention tokenization-free

Last synced: 02 Dec 2024