Projects in Awesome Lists tagged with additive-attention
A curated list of projects in awesome lists tagged with additive-attention .
https://github.com/sooftware/attentions
PyTorch implementation of some attentions for Deep Learning Researchers.
additive-attention attention dot-product-attention location-aware-attention location-sensitive-attension multi-head-attention pytorch relative-multi-head-attention relative-positional-encoding
Last synced: 05 Apr 2025
https://github.com/mtanghu/leap
LEAP: Linear Explainable Attention in Parallel for causal language modeling with O(1) path length, and O(1) inference
additive-attention attention-mechanism deep-learning dot-product-attention linear-attention local-attention parallel pytorch rnn softmax transformer transformers
Last synced: 20 Mar 2025