https://github.com/n8brooks/snowball

⛄ Snowball stemmers for Deno.
https://github.com/n8brooks/snowball

deno languages nlp snowball stopwords

Last synced: 7 days ago
JSON representation

⛄ Snowball stemmers for Deno.

• Host: GitHub
• URL: https://github.com/n8brooks/snowball
• Owner: N8Brooks
• License: bsd-3-clause
• Created: 2022-02-23T08:20:03.000Z (almost 3 years ago)
• Default Branch: main
• Last Pushed: 2022-05-31T20:01:21.000Z (over 2 years ago)
• Last Synced: 2024-04-25T15:43:54.947Z (8 months ago)
• Topics: deno, languages, nlp, snowball, stopwords
• Language: JavaScript
• Homepage: https://deno.land/x/snowball
• Size: 1.55 MB
• Stars: 5
• Watchers: 1
• Forks: 0
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# snowball

[Snowball](https://snowballstem.org/) stemmers for deno. These stemmers are

based on the compiled JavaScript stemmers from the

[snowball project](https://github.com/snowballstem) version 2.2.0.

## Usage

### EnglishStemmer

Provides the stem of the given word. Assumes that the input is lowercase.

```ts

import { assertStrictEquals } from "./test_deps.ts";

import { EnglishStemmer } from "https://deno.land/x/snowball/english_stemmer.ts";

const englishStemmer = new EnglishStemmer();

const stem = englishStemmer.stem("enthusiastically");

assertStrictEquals(stem, "enthusiast");

```

Here is an example with multiple words.

```ts

import { assertStrictEquals } from "./test_deps.ts";

import { EnglishStemmer } from "https://deno.land/x/snowball/english_stemmer.ts";

const sentence = "the quick brown fox jumped over the lazy dog";

const englishStemmer = new EnglishStemmer();

const stemmedSentence = sentence

  .match(/\b\w\w+\b/gu)! // matches two or more word characters

  .map((token) => englishStemmer.stem(token))

  .join(" ");

assertStrictEquals(

  stemmedSentence,

  "the quick brown fox jump over the lazi dog",

);

```

### RussianStemmer

Many languages are supported

```ts

import { assertStrictEquals } from "./test_deps.ts";

import { RussianStemmer } from "https://deno.land/x/snowball/russian_stemmer.ts";

const sentence = "обязательно выпейте свой овалтин";

const russianStemmer = new RussianStemmer();

const stemmedSentence = sentence

  .split(/\s+/u)

  .map((token) => russianStemmer.stem(token))

  .join(" ");

assertStrictEquals(

  stemmedSentence,

  "обязательн вып сво овалтин",

);

```

### LanguageStemmers

There is an `Object` containing all available languages and stemmers defined in

`mod.ts`.

```ts

import { assertStrictEquals } from "https://deno.land/[email protected]/testing/asserts.ts";

import { LanguageStemmers } from "https://deno.land/x/snowball/mod.ts";

const spanishStemmer = new LanguageStemmers["Spanish"]();

assertStrictEquals(

  spanishStemmer.stem("gracias"),

  "graci",

);

```

## Supported Languages

Unless specified, there is only one stemmer available called

***Language***Stemmer which is exported from ***language***_stemmer.ts and

mod.ts. Replace ***language*** with the desired language respecting the hinted

capitalization.

1. Arabic

1. Armenian

1. Basque

1. Catalan

1. Danish

1. Dutch

   1. DutchStemmer

   1. KraaijPohlmannStemmer

1. English

   1. EnglishStemmer - Porter 2 or snowball algorithm

   1. PorterStemmer - Porter 1 stemmer

   1. LovinsStemmer - The first published stemming algorithm

1. Finnish

1. French

1. German

   1. GermanStemmer

   1. German2Stemmer

1. Greek

1. Hindi

1. Hungarian

1. Indonesian

1. Irish

1. Italian

1. Lithuanian

1. Nepali

1. Norwegian

1. Protugese

1. Romanian

1. Russian

1. Serbian

1. Spanish

1. Swedish

1. Tamil

1. Turkish

1. Yiddish