https://github.com/lucidrains/MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
https://github.com/lucidrains/MEGABYTE-pytorch

artificial-intelligence attention-mechanisms deep-learning learned-tokenization long-context transformers

Last synced: 24 days ago
JSON representation

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

• Host: GitHub
• URL: https://github.com/lucidrains/MEGABYTE-pytorch
• Owner: lucidrains
• License: mit
• Created: 2023-05-15T03:27:36.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-05-03T02:13:39.000Z (2 months ago)
• Last Synced: 2024-06-04T10:21:21.230Z (about 1 month ago)
• Topics: artificial-intelligence, attention-mechanisms, deep-learning, learned-tokenization, long-context, transformers
• Language: Python
• Homepage:
• Size: 34.5 MB
• Stars: 593
• Watchers: 10
• Forks: 50
• Open Issues: 3

Lists

• StarryDivineSky - lucidrains/MEGABYTE-pytorch