https://github.com/megagonlabs/ginza-transformers

Use custom tokenizers in spacy-transformers

ginza natural-language-processing nlp spacy spacy-transformers sudachitra tokenizers transformers

Last synced: 12 Apr 2025