Validate tokenizer and model alignment before training#2074

CryptoSalamander wants to merge 7 commits intopytorch:mainpytorch/torchtitan:mainfrom

CryptoSalamander:add-tokenizer-validatorCryptoSalamander/torchtitan:add-tokenizer-validatorCopy head branch name to clipboard