Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/srom/tokenizer
Natural Language Tokenizers implemented in Go
https://github.com/srom/tokenizer
Last synced: about 2 months ago
JSON representation
Natural Language Tokenizers implemented in Go
- Host: GitHub
- URL: https://github.com/srom/tokenizer
- Owner: srom
- License: mit
- Created: 2014-11-30T18:59:40.000Z (about 10 years ago)
- Default Branch: master
- Last Pushed: 2014-12-30T00:39:18.000Z (almost 10 years ago)
- Last Synced: 2024-10-14T22:19:31.067Z (2 months ago)
- Language: Go
- Homepage: http://godoc.org/github.com/srom/tokenizer
- Size: 168 KB
- Stars: 5
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
## Overview
Implementation of various natural language tokenizers in Go.
Tokenizers:
* TreeBankWordTokenizer
* BagOfWordsTokenizer
Documentation: http://godoc.org/github.com/srom/tokenizer
## License
[MIT License](https://github.com/srom/xmlstream/blob/master/LICENSE).