Skip to content

Commit dc68d2f

Browse files
authored
upgrade tokenizers (openvinotoolkit#3463)
<!-- Keep your pull requests (PRs) as atomic as possible. That increases the likelihood that an individual PR won't be stuck because of adjacent problems, merge conflicts, or code review. Your merged PR is going to appear in the automatically generated release notes on GitHub. So the clearer the title the better. --> ## Description <!-- Please include a summary of the change. Also include relevant motivation and context. --> Upgrade to the latest openvino_tokenizers <!-- Jira ticket number (e.g., 123). Delete if there's no ticket. --> CVS-181385 <!-- Remove if not applicable --> Fixes #(issue) ## Checklist: - [ ] This PR follows [GenAI Contributing guidelines](https://github.com/openvinotoolkit/openvino.genai?tab=contributing-ov-file#contributing). (not applicable) - [ ] Tests have been updated or added to cover the new code. No tests should be updated. - [x] This PR fully addresses the ticket. - [ ] I have made corresponding changes to the documentation. No update should be done
1 parent 41b154e commit dc68d2f

1 file changed

Lines changed: 1 addition & 1 deletion