Skip to content

Commit c894846

Browse files
authored
Fix whisper hook generate decorator arguments passing (openvinotoolkit#2873)
## Description Fix whisper hook generate decorator arguments passing Transformer change introduced in: huggingface/transformers#35753 (4.54.1 release) Tested with 4.53, 4.55 transformers <!--- Jira ticket number (e.g., 123). Delete if there's no ticket. Don't include full link or project name. --> Ticket: 174921 ## Checklist: - [x] This patch fully addresses the ticket. <!--- If follow-up pull requests are needed, specify in description. -->
1 parent 64787e3 commit c894846

2 files changed

Lines changed: 4 additions & 4 deletions

File tree

tools/llm_bench/llm_bench_utils/hook_forward_whisper.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -124,8 +124,8 @@ def new_text_sample(self, pipe):
124124
def new_generate(self, pipe):
125125
old_generate = pipe.model.generate
126126

127-
def my_generate(attention_mask, **kwargs):
128-
r = old_generate(attention_mask, **kwargs)
127+
def my_generate(**kwargs):
128+
r = old_generate(**kwargs)
129129
self.set_decoder_time_data()
130130
return r
131131
pipe.model.generate = my_generate

tools/llm_bench/llm_bench_utils/ov_utils.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@
1515
from llm_bench_utils.hook_forward import MeanStdPair, RawImGenPerfMetrics
1616
from llm_bench_utils.model_utils import get_version_in_format_to_pars
1717
from llm_bench_utils.config_class import (
18-
UseCaseTextToSpeech,
18+
UseCaseSpeech2Text,
1919
UseCaseTextGen,
2020
PA_ATTENTION_BACKEND
2121
)
@@ -580,7 +580,7 @@ def create_speech_2_txt_model(model_path, device, memory_data_collector, **kwarg
580580
raise RuntimeError(f'==Failure ==: model path:{model_path} does not exist')
581581
else:
582582
if kwargs.get("genai", True) and is_genai_available(log_msg=True):
583-
if model_class not in [UseCaseTextToSpeech.ov_cls]:
583+
if model_class not in [UseCaseSpeech2Text.ov_cls]:
584584
log.warning("OpenVINO GenAI based benchmarking is not available for required model type. Will be switched to default benchmarking")
585585
else:
586586
log.info("Selected OpenVINO GenAI for benchmarking")

0 commit comments

Comments
 (0)