Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/alexeyev/mystem-scala
Morphological analyzer `mystem` (Russian language) wrapper for JVM languages
https://github.com/alexeyev/mystem-scala
computational-linguistics java lemmatizer mystem natural-language-processing russian-morphology russian-specific scala tokenizer yandex
Last synced: 3 months ago
JSON representation
Morphological analyzer `mystem` (Russian language) wrapper for JVM languages
- Host: GitHub
- URL: https://github.com/alexeyev/mystem-scala
- Owner: alexeyev
- License: mit
- Created: 2015-08-20T23:04:06.000Z (over 9 years ago)
- Default Branch: master
- Last Pushed: 2024-08-29T11:07:41.000Z (5 months ago)
- Last Synced: 2024-08-30T10:12:21.014Z (5 months ago)
- Topics: computational-linguistics, java, lemmatizer, mystem, natural-language-processing, russian-morphology, russian-specific, scala, tokenizer, yandex
- Language: Scala
- Homepage:
- Size: 59.6 KB
- Stars: 24
- Watchers: 3
- Forks: 16
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# A Scala wrapper for morphological analyzer Yandex.MyStem
## Introduction
Details about the algorithm can be found in [I. Segalovich «A fast morphological algorithm with unknown word guessing induced by a dictionary for a web search engine», MLMTA-2003, Las Vegas, Nevada, USA.](http://download.yandex.ru/company/iseg-las-vegas.pdf)
The wrapper's code in under MIT license, but please remember that Yandex.MyStem is not open source and licensed under [conditions of the Yandex License](https://legal.yandex.ru/mystem/).
## System Requirements
The wrapper should at least work on Ubuntu Linux 12.04+, Windows 7+ (+ people say it also works on OS X).
## Install
### Maven
[Maven central](http://search.maven.org/#artifactdetails|ru.stachek66.nlp|mystem-scala|0.1.4|jar)
```xml
ru.stachek66.nlp
mystem-scala
0.1.6
```
## Issues
Only mystem 3.{0,1} are supported currently.
Please [create issues for compatibility troubles and other requests.](https://github.com/alexeyev/mystem-scala/issues)
## Examples
Probably the most important thing to remember when working with mystem-scala is
that you should have just one MyStem instance per mystem/mystem.exe file in your application.
### Scala
```scala
import java.io.File
import ru.stachek66.nlp.mystem.holding.{Factory, MyStem, Request}
object MystemSingletonScala {
val mystemAnalyzer: MyStem =
new Factory("-igd --eng-gr --format json --weight")
.newMyStem(
"3.0",
Option(new File("/home/coolguy/coolproject/3dparty/mystem"))).get()
}
object AppExampleScala extends App {
MystemSingletonScala
.mystemAnalyzer
.analyze(Request("Есть большие пассажиры мандариновой травы"))
.info
.foreach(info => println(info.initial + " -> " + info.lex))
}
```
### Java
```java
import ru.stachek66.nlp.mystem.holding.Factory;
import ru.stachek66.nlp.mystem.holding.MyStem;
import ru.stachek66.nlp.mystem.holding.MyStemApplicationException;
import ru.stachek66.nlp.mystem.holding.Request;
import ru.stachek66.nlp.mystem.model.Info;
import scala.Option;
import scala.collection.JavaConversions;
import java.io.File;
public class MyStemJavaExample {
private final static MyStem mystemAnalyzer =
new Factory("-igd --eng-gr --format json --weight")
.newMyStem("3.0", Option.empty()).get();
public static void main(final String[] args) throws MyStemApplicationException {
final Iterable result =
JavaConversions.asJavaIterable(
mystemAnalyzer
.analyze(Request.apply("И вырвал грешный мой язык"))
.info()
.toIterable());
for (final Info info : result) {
System.out.println(info.initial() + " -> " + info.lex() + " | " + info.rawResponse());
}
}
}
```
## How to Cite
The references to this repository are highly appreciated, if you use our work.
```bibtex
@misc{alekseev2018mystemscala,
author = {Anton Alekseev},
title = {mystem-scala},
year = {2018},
publisher = {GitHub},
journal = {GitHub repository},
howpublished = {\url{https://github.com/alexeyev/mystem-scala/}},
commit = {the latest commit of the codebase you have used}
}
```
If you do cite it, please do not forget to cite [the original algorithm's author's paper](http://download.yandex.ru/company/iseg-las-vegas.pdf) as well.
## Contacts
Anton Alekseev
## Thanks for reviews, reports and contributions
* Vladislav Dolbilov, @darl
* Mikhail Malchevsky
* @anton-shirikov
* Filipp Malkovsky
* @dizzy7
## Also please see
* https://tech.yandex.ru/mystem/
* https://nlpub.ru/Mystem
* https://github.com/Digsolab/pymystem3