https://github.com/king-menin/yttm_transformers_tokenizer

Implementation of youtokentome tokenizer for transformers
https://github.com/king-menin/yttm_transformers_tokenizer

Last synced: about 1 month ago
JSON representation

Implementation of youtokentome tokenizer for transformers

• Host: GitHub
• URL: https://github.com/king-menin/yttm_transformers_tokenizer
• Owner: king-menin
• Created: 2020-08-20T15:26:07.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2020-08-20T15:49:30.000Z (over 4 years ago)
• Last Synced: 2024-10-15T12:26:03.349Z (3 months ago)
• Language: Python
• Size: 4.88 KB
• Stars: 3
• Watchers: 2
• Forks: 1
• Open Issues: 0

Awesome Lists containing this project