https://github.com/src-d/go-youtokentome

https://github.com/src-d/go-youtokentome

Last synced: 6 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/src-d/go-youtokentome
• Owner: src-d
• License: apache-2.0
• Created: 2019-10-11T11:25:54.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2024-03-08T16:14:34.000Z (almost 2 years ago)
• Last Synced: 2025-05-05T05:05:30.972Z (8 months ago)
• Language: Go
• Size: 41 KB
• Stars: 3
• Watchers: 6
• Forks: 5
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md

Awesome Lists containing this project

README

          
# go-YouTokenToMe

go-YouTokenToMe is a Go port of [YoutTokenToMe](https://github.com/VKCOM/YouTokenToMe) - a computationally efficient implementation of Byte Pair Encoding [[Sennrich et al.](https://www.aclweb.org/anthology/P16-1162/)]. Only inference is supported, no training.