Ecosyste.ms: Awesome

Projects in Awesome Lists tagged with dot-product-attention

A curated list of projects in awesome lists tagged with dot-product-attention .

• Sort

  • Recently synced
  • Stars

https://github.com/sooftware/attentions

PyTorch implementation of some attentions for Deep Learning Researchers.

additive-attention attention dot-product-attention location-aware-attention location-sensitive-attension multi-head-attention pytorch relative-multi-head-attention relative-positional-encoding

Last synced: 22 Dec 2024

https://github.com/dcarpintero/transformer101

Annotated vanilla implementation in PyTorch of the Transformer model introduced in 'Attention Is All You Need'

attention-is-all-you-need dot-product-attention dropout-layers encoder-decoder-architecture feedforward-neural-network gelu linear-layers multihead-attention normalization-layers positional-encoding pytorch self-attention softmax transfomer

Last synced: 20 Nov 2024