Skip to content
Back to pull request #23663

[Tokenizer] Add tiktoken format loader for OpenAI BPE vocabularies. #30435

Sign in to view logs

[Tokenizer] Add tiktoken format loader for OpenAI BPE vocabularies.

[Tokenizer] Add tiktoken format loader for OpenAI BPE vocabularies. #30435

Test Sharktank  /  sharktank_tests :: amdgpu_rocm_mi300_gfx942

Test Sharktank / sharktank_tests :: amdgpu_rocm_mi300_gfx942
succeeded Mar 5, 2026 in 9m 14s