Skip to content

[Tokenizer] Add tiktoken format loader for OpenAI BPE vocabularies. #30435

[Tokenizer] Add tiktoken format loader for OpenAI BPE vocabularies.

[Tokenizer] Add tiktoken format loader for OpenAI BPE vocabularies. #30435

Test ONNX  /  test_onnx_models :: cpu_llvm_task

succeeded Mar 5, 2026 in 4m 13s