https://github.com/andrefs/lingua-en-tokenizer-offsets
Finds word (token) boundaries, and returns their offsets.
https://github.com/andrefs/lingua-en-tokenizer-offsets
Last synced: 8 months ago
JSON representation
Finds word (token) boundaries, and returns their offsets.
- Host: GitHub
- URL: https://github.com/andrefs/lingua-en-tokenizer-offsets
- Owner: andrefs
- Created: 2012-06-02T23:06:41.000Z (about 14 years ago)
- Default Branch: master
- Last Pushed: 2012-11-17T01:44:45.000Z (over 13 years ago)
- Last Synced: 2025-01-08T21:41:14.296Z (over 1 year ago)
- Language: Perl
- Size: 109 KB
- Stars: 1
- Watchers: 2
- Forks: 1
- Open Issues: 2
-
Metadata Files: