https://github.com/oelin/axial-rope

A simple implementation of Axial RoPE in PyTorch.
https://github.com/oelin/axial-rope

Last synced: 3 months ago
JSON representation

A simple implementation of Axial RoPE in PyTorch.

• Host: GitHub
• URL: https://github.com/oelin/axial-rope
• Owner: oelin
• License: mit
• Created: 2024-03-12T13:05:34.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-03-12T13:07:20.000Z (over 1 year ago)
• Last Synced: 2024-03-12T14:30:50.569Z (over 1 year ago)
• Language: Python
• Size: 5.86 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# axial-rope

A simple implementation of Axial RoPE in PyTorch.