Fix tokenizer loading for lm-eval on HF checkpoints#4677

eric-czech wants to merge 2 commits intomainmarin-community/marin:mainfrom

eac/lm-eval-hf-tokmarin-community/marin:eac/lm-eval-hf-tokCopy head branch name to clipboard