An open API service indexing awesome lists of open source software.

https://github.com/tanbro/allennlp_wordsplitter_corenlp

CoreNLP word splitter for AllenNLP
https://github.com/tanbro/allennlp_wordsplitter_corenlp

allennlp corenlp corenlp-server nlp nlp-parsing

Last synced: 3 months ago
JSON representation

CoreNLP word splitter for AllenNLP

Awesome Lists containing this project

README

        

# allennlp_wordsplitter_corenlp

Add a [CoreNLP][] `WordSplitter` into [AllenNLP][]'s tokenizers.

## config

```js
{
"dataset_reader": {

// ... ...

"tokenizer": {
"word_splitter": {
"type": "corenlp_remote",
"url": "http://10.1.1.174:9000"
}
},

// ... ...

},

// ... ...

}
```

## CLI

```sh
allennlp train --include-package allennlp_wordsplitter_corenlp -s /your/output/dir /your/training/config/file
```

------
[AllenNLP]: https://allennlp.org/
[CoreNLP]: https://stanfordnlp.github.io/CoreNLP/