porter_stemmers_rs

Porter_stemmers_rs implements the stemmer algorithms from the snowball project which are compiled to Rust using the rust-backend of the snowball compiler.

Supported Languages/Algorithms

• Arabic
• Armenian
• Basque
• Catalan
• Czech,
• Danish
• Dutch
• DutchPorter
• English
• Esperanto
• Estonian
• Finnish
• French
• German
• Greek
• Hindi
• Hungarian
• Indonesian
• Irish
• Italian
• Lithuanian
• Lovins
• Nepali
• Norwegian
• Persian
• Polish
• Porter
• Portuguese
• Romanian
• Russian
• Serbian
• Sesotho
• Spanish
• Swedish
• Tamil
• Turkish
• Ukrainian
• Yiddish

Usage

extern crate porter_stemmers_rs;
use porter_stemmers_rs::{Algorithm, Stemmer};

// Create a stemmer for the english language
let en_stemmer = Stemmer::create(Algorithm::English);

// Stem the word "fishing"
// All algorithms expect their input in lowercase.
assert_eq!(en_stemmer.stem("fishing"), "fish");

Add an additional Language

To create an additional stemmer language for Rust from the official Snowball repository, you must use the Snowball compiler (snowball) to translate the language algorithm definition into Rust source code.

Build the Snowball Compiler

The Snowball compiler is written in ISO C. You first need to build it to generate the executable that performs the translation.

Clone the repository: git clone https://github.com/snowballstem/snowball.git

Compile the compiler: Navigate to the root and run make. This produces the snowball executable.

Generate Rust Code for the additional stemmer language

The algorithm definition is located at algorithms/additional_language.sbl. Use the compiler with the -rust flag to generate the Rust implementation.

Command: ./snowball algorithms/additional_language.sbl -rust -o additional_language