https://github.com/sooftware/attentions

PyTorch implementation of some attentions for Deep Learning Researchers.

additive-attention attention dot-product-attention location-aware-attention location-sensitive-attension multi-head-attention pytorch relative-multi-head-attention relative-positional-encoding

Last synced: 05 Apr 2025