Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/lucidrains/MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
https://github.com/lucidrains/MEGABYTE-pytorch

artificial-intelligence attention-mechanisms deep-learning learned-tokenization long-context transformers

Last synced: about 2 months ago
JSON representation

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

Host: GitHub
URL: https://github.com/lucidrains/MEGABYTE-pytorch
Owner: lucidrains
License: mit
Created: 2023-05-15T03:27:36.000Z (over 1 year ago)
Default Branch: main
Last Pushed: 2024-05-03T02:13:39.000Z (5 months ago)
Last Synced: 2024-07-13T04:23:51.035Z (2 months ago)
Topics: artificial-intelligence, attention-mechanisms, deep-learning, learned-tokenization, long-context, transformers
Language: Python
Homepage:
Size: 34.5 MB
Stars: 600
Watchers: 10
Forks: 51
Open Issues: 3