Conversation
| SUPPORTED_ARCHITECTURES += ("glm", "mistral-nemo", "minicpm3", "phi3-moe") | ||
| # openvino 2025.0 required for disabling check_trace | ||
| if is_openvino_version(">=", "2025.0"): | ||
| SUPPORTED_ARCHITECTURES += ("deepseek",) |
There was a problem hiding this comment.
actually remote code deepseek_v3 : katuni4ka/tiny-random-deepseek-v3
rkazants
left a comment
rkazants
left a comment
There was a problem hiding this comment.
please add tests for export and inference
| @register_in_tasks_manager( | ||
| "deepseek_v3", *["text-generation", "text-generation-with-past"], library_name="transformers" | ||
| ) | ||
| class DeepseekVOpenVINOConfig(LlamaOpenVINOConfig): |
There was a problem hiding this comment.
before we can merge : need to fix rope_interleave for export https://github.com/huggingface/transformers/blob/v4.55.4/src/transformers/models/deepseek_v3/modeling_deepseek_v3.py#L402
There was a problem hiding this comment.
cc @openvino-dev-samples any news on this on your side ?
There was a problem hiding this comment.
sorry, I was not working on this issue.
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
|
@bot /style |
|
Style fix runs successfully without any file modified. |
4 participants
No description provided.