chore: allow to set tokenizer in the nemo-run script#884

marta-sd merged 1 commit intomainNVIDIA-NeMo/Evaluator:mainfrom

martas/nemo-run-logprobsNVIDIA-NeMo/Evaluator:martas/nemo-run-logprobsCopy head branch name to clipboard