https://github.com/pharo-ai/stopwords

Load the stopwords that you need in Pharo
https://github.com/pharo-ai/stopwords

nlp nlp-machine-learning pharo pharo-smalltalk stopwords tf-idf

Last synced: about 1 month ago
JSON representation

Load the stopwords that you need in Pharo

• Host: GitHub
• URL: https://github.com/pharo-ai/stopwords
• Owner: pharo-ai
• License: mit
• Created: 2021-01-27T22:26:21.000Z (almost 4 years ago)
• Default Branch: master
• Last Pushed: 2021-02-24T00:07:32.000Z (almost 4 years ago)
• Last Synced: 2024-10-31T06:24:55.331Z (3 months ago)
• Topics: nlp, nlp-machine-learning, pharo, pharo-smalltalk, stopwords, tf-idf
• Language: Smalltalk
• Homepage:
• Size: 44.9 KB
• Stars: 3
• Watchers: 5
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Description

Load the stopwords that you need in Pharo

## Installation

```smalltalk

Metacello new

  baseline: 'AIStopwords';

  repository: 'github://pharo-ai/stopwords/src';

  load.

```

## How to depend on it?

If you want to add a dependency on stopwords to your project, include the following lines into your baseline method:

```Smalltalk

spec

  baseline: 'AIStopwords'

  with: [ spec repository: 'github://pharo-ai/stopwords/src' ].

```

If you are new to baselines and Metacello, check out the [Baselines](https://github.com/pharo-open-documentation/pharo-wiki/blob/master/General/Baselines.md) tutorial on Pharo Wiki.

## How to use it?

### Explore available stopwords 

You can use the class façade to quickly obtain a stop word Collection. It supports multiple stopwords repositories (implemented as subclasses), but a default list is automatically configured. Users could get a list of stop words for a language, you can use the pattern:

```smalltalk

AIStopwords for.

```

for example:

```smalltalk

AIStopwords forEnglish.

AIStopwords forSpanish.

AIStopwords forFrench.

```

To change the default stopword class for a language:

```smalltalk

AIStopwordsEnglish defaultStopwordClass: aClass.

```

Stopwords list were collected from https://github.com/igorbrigadir/stopwords

### Check for stopwords

Example of usage:

```smalltalk

'This is Ground Control to Major Tom' removeStopwordsUsing: AIStopwords forEnglish

```

will answer a Collection without the stopwords:

```smalltalk

#('Ground' 'Control' 'Major' 'Tom')

```

### Add your stopwords to a list

Stopwords now can be augmented with #addStopword: and #addStopwords:

```smalltalk

AIStopwordsEngCoreNLP new addStopword: 'myStopword'.

AIStopwordsEngLuceneSolr new addStopwords: #('stopword1' 'stopword2').

```