Commit dc68d2f
authored
upgrade tokenizers (openvinotoolkit#3463)
<!-- Keep your pull requests (PRs) as atomic as possible. That increases
the likelihood that an individual PR won't be stuck because of adjacent
problems, merge conflicts, or code review.
Your merged PR is going to appear in the automatically generated release
notes on GitHub. So the clearer the title the better. -->
## Description
<!-- Please include a summary of the change. Also include relevant
motivation and context. -->
Upgrade to the latest openvino_tokenizers
<!-- Jira ticket number (e.g., 123). Delete if there's no ticket. -->
CVS-181385
<!-- Remove if not applicable -->
Fixes #(issue)
## Checklist:
- [ ] This PR follows [GenAI Contributing
guidelines](https://github.com/openvinotoolkit/openvino.genai?tab=contributing-ov-file#contributing).
(not applicable)
- [ ] Tests have been updated or added to cover the new code. No tests
should be updated.
- [x] This PR fully addresses the ticket.
- [ ] I have made corresponding changes to the documentation. No update
should be done1 parent 41b154e commit dc68d2f
1 file changed
Lines changed: 1 addition & 1 deletion
Submodule openvino_tokenizers updated 14 files
- .github/workflows/coverity.yml+5-5
- .github/workflows/labeler.yml+1-1
- .github/workflows/linux.yml+26-19
- .github/workflows/mac.yml+15-15
- .github/workflows/manylinux_2_28.yml+10-10
- .github/workflows/sdl.yml+1-1
- .github/workflows/windows.yml+18-18
- poetry.lock+359-510
- pyproject.toml+5-2
- python/openvino_tokenizers/hf_parser.py+2-2
- tests/conftest.py+3-2
- tests/pass_rates.json+2-1
- tests/stats.json+10.2k-11.2k
- tests/tokenizers_test.py+1-1
0 commit comments