Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/lucidrains/MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
https://github.com/lucidrains/MEGABYTE-pytorch

artificial-intelligence attention-mechanisms deep-learning learned-tokenization long-context transformers

Last synced: about 1 month ago
JSON representation

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

Host: GitHub
URL: https://github.com/lucidrains/MEGABYTE-pytorch
Owner: lucidrains
License: mit
Created: 2023-05-15T03:27:36.000Z (over 1 year ago)
Default Branch: main
Last Pushed: 2024-09-16T12:33:34.000Z (3 months ago)
Last Synced: 2024-11-11T19:40:39.653Z (about 1 month ago)
Topics: artificial-intelligence, attention-mechanisms, deep-learning, learned-tokenization, long-context, transformers
Language: Python
Homepage:
Size: 34.5 MB
Stars: 624
Watchers: 11
Forks: 52
Open Issues: 3
Metadata Files:
- Readme: README.md
- License: LICENSE