Skip to content
Closed
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 8 additions & 1 deletion site/assets/javascripts/lunr/tinyseg.js
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,14 @@
// TinySegmenter 0.1 -- Super compact Japanese tokenizer in Javascript
// (c) 2008 Taku Kudo <taku@chasen.org>
// TinySegmenter is freely distributable under the terms of a new BSD licence.
// For details, see http://chasen.org/~taku/software/TinySegmenter/LICENCE.txt
/**
* Creates a TinySegmenter instance configured with statistical tables for Japanese tokenization.
*
* Initializes character-type patterns and the internal weight tables used by the segmentation algorithm.
*
* @constructor
* @returns {TinySegmenter} The initialized TinySegmenter instance.
*/

function TinySegmenter() {
var patterns = {
Expand Down