An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with segmenter

A curated list of projects in awesome lists tagged with segmenter .

https://github.com/chatopera/chop

Chinese Tokenizer module for Python

chinese-nlp chinese-segmenter nlp parser segment segmenter

Last synced: 20 Mar 2025

https://github.com/jonschlinkert/intl-segmenter

A high-performance wrapper around Intl.Segmenter for efficient text segmentation. This class resolves memory handling issues seen with large strings and "maximum call stack exceeded" exceptions that occur when strings exceed 40-50k characters. Enhances performance by 50-500x. Only ~70 loc (with comments) and no dependencies.

graphemes intl intl-segmenter processing segment segmenter sentences splitter text words

Last synced: 15 Apr 2025

https://github.com/jordicenzano/fmp4-stream-online-segmenter

This is a tool that allows you to create an DASH manifest from any fmp4 stream file. There are online and CLI versions, also we provide file and stream versions

dash fmp4 mp4 segmenter video

Last synced: 06 Mar 2026

https://github.com/xamgore/segtok

A rule-based sentence segmenter (splitter) and a word tokenizer using orthographic features

nlp segmenter tokenizer

Last synced: 02 Mar 2026

https://github.com/lz1998/cgo_icu4x_segmenter

Segment strings by word and sentences. See icu4x for more details.

cgo ffi golang icu icu4x rust segmenter sentence

Last synced: 17 Mar 2025