Projects in Awesome Lists tagged with japanese-tokenizer
A curated list of projects in awesome lists tagged with japanese-tokenizer .
https://github.com/lionsoul2014/friso
High performance Chinese tokenizer with both GBK and UTF-8 charset support based on MMSEG algorithm developed by ANSI C. Completely based on modular implementation and can be easily embedded in other programs, like: MySQL, PostgreSQL, PHP, etc.
c chinese-tokenizer chinese-word-segmentation cjk-tokenizer full-text-search japanese-tokenizer korean-tokenizer php-tokenizer tokenizer
Last synced: 05 Apr 2025
https://github.com/luckasranarison/kaiseki
A japanese tokenizer and morphological analyzer
japanese-tokenizer morphological-analyser nlp rust
Last synced: 06 Apr 2025
https://github.com/wtnabe/sudachi-installer-rb
A Helper gem for download and store Sudachi jar and dict files written with Ruby ( for combination with `rudachi` )
japanese-tokenizer ruby sudachi
Last synced: 13 Nov 2024
