Skip to content

[Tokenizer] Add tiktoken format loader for OpenAI BPE vocabularies. #30435

[Tokenizer] Add tiktoken format loader for OpenAI BPE vocabularies.

[Tokenizer] Add tiktoken format loader for OpenAI BPE vocabularies. #30435

Test ONNX  /  test_onnx_ops :: cpu_llvm_sync_O2

succeeded Mar 5, 2026 in 4m 33s