Uniitxt 1.4.0

Enhancements

• New random generation mechanism to remove dependency between different random generators @matanor in #414
• New MultipleChoiceTemplate which changes all QA datasets by @elronbandel in #405
• New MAP, MRR, and Retrieval@K metrics by @assaftibm in #422
• New LoadFromKaggle loader which allows direct loading of datasets from Kaggle by @ilyashnil in #413
• New StringContainment metric that if one of the references is contained in the prediction by @ellarabi in #394
• New ConvertToBoolean post processor that changes the predict to either TRUE or FALSE by @ellarabi in #394
• 15 new open source classification datasets by @ilyashnil in #410, #418
• Documentation is now automatically generate in each release (#384)

Bug fixes

• Fixed and improved error checking in multi label F1 by @yoavkatz in #390
• Changed translations to use normalized_sacrebleu by @gitMichal in #426

Non backward compatible changes

• MultipleChoice QA datasets need to move to new MultipleChoiceTemplates
• Translation blue metric is now between 0-1 and not 0-100
• New randomization mechanism may change selects selection of demos , randomized text augmentation, or any other random choice.

What's Changed

• metric and processor related to robustness evaluation by @ellarabi in #394
• Removed variable set in debugging by @yoavkatz in #409
• Adding simple datasets by @ilyashnil in #410
• Add multiple choice template and fix mmlu by @elronbandel in #405
• Fixed error check in multi label F1 by @yoavkatz in #390
• FIX multiple choice template by @perlitz in #416
• example of kaggle loader by @ilyashnil in #413
• Medical abstract by @ilyashnil in #418
• Multilabel and jsons by @ilyashnil in #419
• Improve dataset addition tutorial + Fix auto uploads of the catalog to the web by @elronbandel in #384
• Improve docs by @elronbandel in #420
• Fix docs and docs compilation tests by @elronbandel in #421
• Hard code classes names by @elronbandel in #425
• Retrieval metrics by @assaftibm in #422
• modify to different bleu impl. by @gitMichal in #426
• Improve docs by @elronbandel in #427
• Independent random generators by @matanor in #414

New Contributors

• @ellarabi made their first contribution in #394

Full Changelog: 1.3.1...1.4.0