https://github.com/tillbeemelmanns/learnable_fourier_positional_encoding

Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding - Tensorflow
https://github.com/tillbeemelmanns/learnable_fourier_positional_encoding

positional-encoding transfomer vision-transformer

Last synced: 16 days ago
JSON representation

Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding - Tensorflow

• Host: GitHub
• URL: https://github.com/tillbeemelmanns/learnable_fourier_positional_encoding
• Owner: TillBeemelmanns
• Created: 2023-06-15T16:35:17.000Z (almost 3 years ago)
• Default Branch: main
• Last Pushed: 2023-06-16T16:12:22.000Z (almost 3 years ago)
• Last Synced: 2025-01-25T07:07:24.535Z (over 1 year ago)
• Topics: positional-encoding, transfomer, vision-transformer
• Language: Jupyter Notebook
• Homepage:
• Size: 22.5 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding

# Tensorflow Implementation

Base on the paper https://arxiv.org/abs/2106.02795

```

@misc{li2021learnable,

      title={Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding}, 

      author={Yang Li and Si Si and Gang Li and Cho-Jui Hsieh and Samy Bengio},

      year={2021},

      eprint={2106.02795},

      archivePrefix={arXiv},

      primaryClass={cs.LG}

}

```

and the Pytorch implementation: 

[https://github.com/willGuimont/learnable_fourier_positional_encoding](https://github.com/willGuimont/learnable_fourier_positional_encoding)