https://github.com/akr4/tantivy-vibrato

A Tantivy tokenizer using Vibrato.
https://github.com/akr4/tantivy-vibrato

Last synced: about 1 month ago
JSON representation

A Tantivy tokenizer using Vibrato.

• Host: GitHub
• URL: https://github.com/akr4/tantivy-vibrato
• Owner: akr4
• License: mit
• Created: 2022-08-25T04:22:48.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2023-01-19T01:12:43.000Z (almost 2 years ago)
• Last Synced: 2024-09-18T03:01:36.021Z (about 2 months ago)
• Language: Rust
• Size: 6.84 KB
• Stars: 3
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# tantivy-vibrato

A [Tantivy](https://github.com/quickwit-oss/tantivy) tokenizer using [Vibrato](https://github.com/daac-tools/vibrato).

![Crates.io](https://img.shields.io/crates/v/tantivy-vibrato)

## Usage

```rust

let tokenizer = VibratoTokenizer::new("/path/to/dictionary")?;

let analyzer = TextAnalyzer::from(tokenizer).filter(LowerCaser);

index.tokenizers().register("lang_ja", analyzer);

```

You need to specify a path to the Vibrato's dictionary file.