https://github.com/tanbro/allennlp_wordsplitter_corenlp
CoreNLP word splitter for AllenNLP
https://github.com/tanbro/allennlp_wordsplitter_corenlp
allennlp corenlp corenlp-server nlp nlp-parsing
Last synced: 3 months ago
JSON representation
CoreNLP word splitter for AllenNLP
- Host: GitHub
- URL: https://github.com/tanbro/allennlp_wordsplitter_corenlp
- Owner: tanbro
- Created: 2018-11-19T06:30:47.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2019-01-17T02:43:15.000Z (over 6 years ago)
- Last Synced: 2025-02-28T20:48:06.779Z (4 months ago)
- Topics: allennlp, corenlp, corenlp-server, nlp, nlp-parsing
- Language: Python
- Size: 22.5 KB
- Stars: 0
- Watchers: 3
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
Awesome Lists containing this project
README
# allennlp_wordsplitter_corenlp
Add a [CoreNLP][] `WordSplitter` into [AllenNLP][]'s tokenizers.
## config
```js
{
"dataset_reader": {// ... ...
"tokenizer": {
"word_splitter": {
"type": "corenlp_remote",
"url": "http://10.1.1.174:9000"
}
},// ... ...
},
// ... ...
}
```## CLI
```sh
allennlp train --include-package allennlp_wordsplitter_corenlp -s /your/output/dir /your/training/config/file
```------
[AllenNLP]: https://allennlp.org/
[CoreNLP]: https://stanfordnlp.github.io/CoreNLP/