totalNumberOfWords

[patrickjae]

In mallet branch, HDPGibbsSampler line 71-73
simply adding the length of data to totalNumberOfWords should be faster than traversing an index and adding one each time, especially for very large documents
might look like this:

totalNumberOfWords += ((FeatureSequence) corpus.get(d).getData()).getLength();

[arnim]

THX - U R right.
Will refactor these lines anyway ;)
However; adding data to the sampler is not the place where a huge proportion of computation is spent.